Jun 15 07:08:51 devstack cinder-volume[81465]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81465) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 15 07:08:51 devstack cinder-volume[81465]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81465) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 15 07:08:51 devstack cinder-volume[81465]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81465) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 15 07:08:51 devstack cinder-volume[81465]: INFO dbcounter [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Registered counter for database cinder Jun 15 07:08:51 devstack cinder-volume[81465]: DEBUG oslo_db.sqlalchemy.engines [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81465) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:08:51 devstack cinder-volume[81465]: DEBUG dbcounter [-] [81465] Writer thread running {{(pid=81465) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 15 07:08:51 devstack cinder-volume[81465]: INFO cinder.rpc [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 15 07:08:51 devstack cinder-volume[81465]: INFO cinder.rpc [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 15 07:08:51 devstack cinder-volume[81465]: DEBUG oslo_db.sqlalchemy.engines [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81465) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:08:52 devstack cinder-volume[81465]: INFO cinder.volume.manager [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Determined volume DB was empty at startup. Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG cinder.volume.manager [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81465) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 15 07:08:52 devstack cinder-volume[81465]: INFO cinder.volume.manager [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 15 07:08:52 devstack cinder-volume[81465]: WARNING stevedore.named [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 15 07:08:52 devstack cinder-volume[81465]: WARNING castellan.key_manager [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 15 07:08:52 devstack cinder-volume[81465]: WARNING cinder.keymgr.conf_key_mgr [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG cinder.volume.drivers.lvm [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=81465) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_concurrency.processutils [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=81465) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_concurrency.processutils [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] CMD "cinder-rtstool verify" returned: 0 in 0.379s {{(pid=81465) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_db.sqlalchemy.engines [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81465) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:08:52 devstack cinder-volume[81465]: INFO cinder.rpc [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 15 07:08:52 devstack cinder-volume[81465]: INFO cinder.rpc [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 15 07:08:52 devstack cinder-volume[81465]: WARNING stevedore.named [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 15 07:08:52 devstack cinder-volume[81465]: WARNING castellan.key_manager [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 15 07:08:52 devstack cinder-volume[81465]: INFO cinder.volume.manager [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_db.sqlalchemy.engines [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81465) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:08:52 devstack cinder-volume[81465]: INFO oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Starting 1 workers Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Started child 81633 {{(pid=81465) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Full set of CONF: {{(pid=81465) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] ******************************************************************************** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Configuration options gathered from: {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] ================================================================================ {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] allow_availability_zone_fallback = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] allow_compression_on_image_upload = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] allowed_direct_url_schemes = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81633]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] api_rate_limit = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] auth_strategy = keystone {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] az_cache_duration = 3600 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_availability_zone = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_host = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_stats_polling_interval = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backup_api_class = cinder.backup.api.API {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backup_name_template = backup-%s {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backup_use_same_host = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backup_use_temp_snapshot = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] chap_password = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] chap_username = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cinder_internal_tenant_project_id = f74a69608b7e4161bd24f484b1590383 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cinder_internal_tenant_user_id = 00238d2ae5e24c32b4884292b32cb15d {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cloned_volume_same_az = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cluster = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] compression_format = gzip {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] compute_api_class = cinder.compute.nova.API {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] config_dir = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] config_source = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] control_exchange = openstack {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] debug = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] default_availability_zone = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] default_group_type = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] default_volume_type = lvmdriver-1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] disk_geometry = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] driver_client_cert = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] driver_client_cert_key = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] driver_data_namespace = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] driver_ssl_cert_path = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] driver_ssl_cert_verify = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] driver_use_ssl = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] enable_force_upload = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] enable_new_services = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] enable_unsupported_driver = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] enabled_backends = ['lvmdriver-1'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] enforce_multipath_for_image_xfer = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] filter_function = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance_api_insecure = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance_api_servers = ['http://192.168.122.147/image'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance_api_ssl_compression = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance_ca_certificates_file = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance_catalog_info = image:glance:publicURL {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance_certfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance_keyfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance_num_retries = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance_request_timeout = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] goodness_function = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] graceful_shutdown_timeout = 5 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] group_api_class = cinder.group.api.API {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] host = devstack {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] image_compress_on_upload = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] image_conversion_address_space_limit = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] image_conversion_cpu_limit = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] image_conversion_disable = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] image_upload_use_cinder_backend = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] image_upload_use_internal_tenant = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] image_volume_cache_enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] image_volume_cache_max_count = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] image_volume_cache_max_size_gb = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] init_host_max_objects_retrieval = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] instance_format = [instance: %(uuid)s] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] iscsi_target_flags = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] iscsi_write_cache = on {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] iser_helper = tgtadm {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] iser_ip_address = 192.168.122.147 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] iser_port = 3260 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] log_color = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] log_config_append = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] log_dir = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] log_file = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] log_options = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] log_rotate_interval = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] log_rotate_interval_type = days {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] log_rotation_type = none {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] max_age = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] max_logfile_count = 30 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] max_logfile_size_mb = 200 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] max_over_subscription_ratio = 20.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] message_reap_interval = 86400 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] message_ttl = 2592000 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] migration_create_volume_timeout_secs = 300 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] monkey_patch = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] monkey_patch_modules = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] my_ip = 192.168.122.147 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] no_snapshot_gb_quota = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] num_iser_scan_tries = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] num_shell_tries = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] num_volume_device_scan_tries = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] nvmeof_conn_info_version = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] nvmet_ns_id = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] nvmet_port_id = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] osapi_max_limit = 1000 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] osapi_volume_ext_list = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81633]: INFO cinder.volume.manager [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] osapi_volume_listen = 0.0.0.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] osapi_volume_listen_port = 8776 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] osapi_volume_use_ssl = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] osapi_volume_workers = 2 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] per_volume_size_limit = -1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] periodic_fuzzy_delay = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] periodic_interval = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] project_id_regex = [0-9a-f\-]+ {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] public_endpoint = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] publish_errors = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] quota_backup_gigabytes = 1000 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] quota_backups = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] quota_gigabytes = 1000 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] quota_groups = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] quota_snapshots = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] quota_volumes = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] rate_limit_burst = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] rate_limit_except_level = CRITICAL {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] rate_limit_interval = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] reinit_driver_count = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] replication_device = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] report_discard_supported = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] report_interval = 120 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] reservation_clean_interval = 86400 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] reservation_expire = 86400 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] reserved_image_namespaces = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] reserved_percentage = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] rpc_response_timeout = 120 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] run_external_periodic_tasks = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] scst_target_driver = iscsi {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] scst_target_iqn_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] service_down_time = 720 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] shell_completion = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] snapshot_name_template = snapshot-%s {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] snapshot_same_host = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] split_loggers = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] state_path = /opt/stack/data/cinder {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] storage_availability_zone = nova {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] storage_protocol = iSCSI {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] syslog_log_facility = LOG_USER {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] target_helper = lioadm {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] target_ip_address = 192.168.122.147 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] target_port = 3260 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] target_protocol = iscsi {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] target_secondary_ip_addresses = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] trace_flags = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] transfer_api_class = cinder.transfer.api.API {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] transport_url = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] until_refresh = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] use_chap_auth = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] use_default_quota_class = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] use_journal = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] use_json = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] use_multipath_for_image_xfer = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] use_stderr = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] use_syslog = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] verify_glance_signatures = enabled {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] volume_api_class = cinder.volume.api.API {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] volume_backend_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] volume_clear = zero {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] volume_clear_ionice = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] volume_clear_size = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] volume_copy_bps_limit = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] volume_dd_blocksize = 1M {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] volume_name_template = volume-%s {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] volume_service_inithost_offload = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] volume_usage_audit_period = month {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] zoning_mode = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_concurrency.disable_process_locking = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.admin_password = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.admin_token = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.admin_user = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.auth_admin_prefix = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.auth_port = 35357 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.auth_protocol = https {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.auth_section = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.auth_type = password {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.auth_uri = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.auth_version = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.cache = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.certfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.delay_auth_decision = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.http_connect_timeout = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.identity_uri = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.include_service_catalog = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.insecure = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.interface = public {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.keyfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.memcache_password = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.memcache_username = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.region_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.service_token_roles_required = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.service_type = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.token_cache_time = 300 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.147/identity {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.backend = dogpile.cache.null {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.backend_argument = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.backend_expiration_time = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.config_prefix = cache.oslo {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.debug_cache_backend = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.enable_retry_client = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.enable_socket_keepalive = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.enforce_fips_mode = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.expiration_time = 600 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.hashclient_retry_attempts = 2 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.memcache_dead_retry = 300 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.memcache_pool_maxsize = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.memcache_sasl_enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.password = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.proxies = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.redis_db = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.redis_sentinel_service_name = mymaster {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.redis_server = localhost:6379 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.retry_attempts = 2 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.retry_delay = 0.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.socket_keepalive_count = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.socket_keepalive_idle = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.socket_keepalive_interval = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.socket_timeout = 1.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.tls_allowed_ciphers = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.tls_cafile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.tls_certfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.tls_enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.tls_keyfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cache.username = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.asyncio_connection = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.asyncio_slave_connection = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.backend = sqlalchemy {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.connection = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.connection_debug = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.connection_parameters = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.connection_recycle_time = 3600 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.connection_trace = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.db_inc_retry_interval = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.db_max_retries = 20 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.db_max_retry_interval = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.db_retry_interval = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.max_overflow = 50 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.max_pool_size = 5 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.max_retries = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.mysql_wsrep_sync_wait = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.pool_timeout = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.retry_interval = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.slave_connection = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.sqlite_synchronous = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.synchronous_reader = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] database.use_db_reconnect = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] profiler.connection_string = messaging:// {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:08:52 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:08:52 devstack sudo[81637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] profiler.enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] profiler.es_doc_type = notification {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] profiler.es_scroll_size = 10000 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] profiler.es_scroll_time = 2m {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] profiler.filter_error_trace = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] profiler.hmac_keys = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] profiler.sentinel_service_name = mymaster {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack sudo[81637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] profiler.socket_timeout = 0.1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] profiler.trace_requests = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] profiler.trace_sqlalchemy = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] profiler_jaeger.process_tags = {} {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] profiler_jaeger.service_name_prefix = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] profiler_otlp.service_name_prefix = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_policy.enforce_new_defaults = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: WARNING oslo_config.cfg [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_policy.enforce_scope = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_policy.policy_default_rule = default {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_policy.policy_file = policy.yaml {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_policy.remote_timeout = 60.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] coordination.backend_url = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] privsep_osbrick.group = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] privsep_osbrick.helper_command = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] privsep_osbrick.user = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cinder_sys_admin.group = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cinder_sys_admin.helper_command = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] cinder_sys_admin.user = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] service_user.auth_section = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] service_user.auth_type = password {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] service_user.cafile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] service_user.certfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] service_user.collect_timing = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] service_user.insecure = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] service_user.keyfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] service_user.send_service_user_token = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] service_user.split_loggers = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] service_user.timeout = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance.auth_section = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance.auth_type = password {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance.certfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance.collect_timing = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance.insecure = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance.keyfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance.region_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance.split_loggers = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:52 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] glance.timeout = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.backend_availability_zone = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.chap_password = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.chap_username = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.disk_geometry = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.driver_client_cert = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.driver_client_cert_key = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.driver_data_namespace = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.driver_use_ssl = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.enable_unsupported_driver = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.extra_capabilities = {} {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.filter_function = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.goodness_function = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.iscsi_target_flags = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.iscsi_write_cache = on {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.iser_helper = tgtadm {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.iser_ip_address = 192.168.122.147 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.iser_port = 3260 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.lvm_mirrors = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.lvm_share_target = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.lvm_type = auto {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.num_shell_tries = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.nvmet_port_id = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.replication_device = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.report_discard_supported = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.reserved_percentage = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.scst_target_driver = iscsi {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.scst_target_iqn_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.storage_protocol = iSCSI {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.target_helper = tgtadm {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.target_ip_address = 192.168.122.147 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.target_port = 3260 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.target_protocol = iscsi {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.trace_flags = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.unique_fqdn_network = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.use_chap_auth = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.volume_backend_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.volume_clear = zero {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.volume_clear_ionice = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.volume_clear_size = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.volume_group = cinder-volumes {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_reports.file_event_handler = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_reports.log_dir = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.backend_availability_zone = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.backend_host = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.chap_password = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.chap_username = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.chiscsi_conf = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.disk_geometry = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.driver_client_cert = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.driver_data_namespace = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.driver_use_ssl = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.extra_capabilities = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.filter_function = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.goodness_function = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.iser_helper = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.iser_ip_address = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.iser_port = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.iser_target_prefix = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.lvm_conf_file = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.lvm_mirrors = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.lvm_share_target = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.lvm_type = auto {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.num_shell_tries = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.nvmet_port_id = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.replication_device = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.report_discard_supported = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.reserved_percentage = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.scst_target_driver = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.storage_protocol = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.target_helper = lioadm {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.target_ip_address = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.target_port = 3260 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.target_protocol = iscsi {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.trace_flags = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.use_chap_auth = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.volume_clear = zero {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.volume_clear_size = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] lvmdriver-1.volumes_dir = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.ssl = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.ssl_version = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_notifications.driver = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_notifications.retry = -1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] oslo_messaging_notifications.transport_url = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] key_manager.fixed_key = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican.barbican_api_version = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican.barbican_endpoint = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican.barbican_endpoint_type = public {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican.barbican_region_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican.cafile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican.certfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican.collect_timing = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican.insecure = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican.keyfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican.number_of_retries = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican.retry_delay = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican.send_service_user_token = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican.split_loggers = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican.timeout = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican.verify_ssl = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican.verify_ssl_path = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican_service_user.auth_section = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican_service_user.auth_type = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican_service_user.cafile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican_service_user.certfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican_service_user.collect_timing = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican_service_user.insecure = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican_service_user.keyfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican_service_user.split_loggers = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] barbican_service_user.timeout = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] vault.approle_role_id = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] vault.approle_secret_id = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] vault.kv_mountpoint = secret {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] vault.kv_path = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] vault.kv_version = 2 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] vault.namespace = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] vault.root_token_id = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] vault.ssl_ca_crt_file = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] vault.timeout = 60.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] vault.use_ssl = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:08:53 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] ******************************************************************************** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 15 07:08:53 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.827s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:08:53 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:08:53 devstack sudo[81637]: pam_unix(sudo:session): session closed for user root Jun 15 07:08:53 devstack sudo[81647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:08:53 devstack sudo[81647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:08:54 devstack sudo[81647]: pam_unix(sudo:session): session closed for user root Jun 15 07:08:54 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.638s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:08:54 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:08:54 devstack cinder-volume[81633]: INFO cinder.brick.local_dev.lvm [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 15 07:08:54 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:08:54 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:08:54 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:08:54 devstack sudo[81853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:08:54 devstack sudo[81853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:08:54 devstack sudo[81853]: pam_unix(sudo:session): session closed for user root Jun 15 07:08:54 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:08:54 devstack cinder-volume[81633]: DEBUG cinder.brick.local_dev.lvm [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=81633) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 15 07:08:54 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:08:54 devstack sudo[82045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:08:54 devstack sudo[82045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:08:56 devstack sudo[82045]: pam_unix(sudo:session): session closed for user root Jun 15 07:08:56 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.718s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:08:56 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:08:56 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:08:56 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:08:56 devstack sudo[82372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:08:56 devstack sudo[82372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:08:57 devstack sudo[82372]: pam_unix(sudo:session): session closed for user root Jun 15 07:08:57 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.739s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:08:57 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:08:57 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:08:57 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:08:57 devstack sudo[82419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 15 07:08:57 devstack sudo[82419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:08:58 devstack sudo[82419]: pam_unix(sudo:session): session closed for user root Jun 15 07:08:58 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.643s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:08:58 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:08:58 devstack sudo[82422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:08:58 devstack sudo[82422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:08:58 devstack sudo[82422]: pam_unix(sudo:session): session closed for user root Jun 15 07:08:58 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:08:58 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:08:58 devstack sudo[82428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:08:58 devstack sudo[82428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:08:59 devstack sudo[82428]: pam_unix(sudo:session): session closed for user root Jun 15 07:08:59 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:08:59 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:08:59 devstack sudo[82431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:08:59 devstack sudo[82431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:08:59 devstack sudo[82431]: pam_unix(sudo:session): session closed for user root Jun 15 07:08:59 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:08:59 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:08:59 devstack sudo[82436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:08:59 devstack sudo[82436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:09:00 devstack sudo[82436]: pam_unix(sudo:session): session closed for user root Jun 15 07:09:00 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.875s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:09:00 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:09:00 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:09:00 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:09:00 devstack sudo[82444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:09:00 devstack sudo[82444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:09:01 devstack sudo[82444]: pam_unix(sudo:session): session closed for user root Jun 15 07:09:01 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.614s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:09:01 devstack cinder-volume[81633]: INFO cinder.volume.drivers.lvm [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 15 07:09:01 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:09:01 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:09:01 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:09:01 devstack sudo[82448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:09:01 devstack sudo[82448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:09:02 devstack sudo[82448]: pam_unix(sudo:session): session closed for user root Jun 15 07:09:02 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.935s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:09:02 devstack cinder-volume[81633]: DEBUG cinder.volume.drivers.lvm [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Updating volume stats {{(pid=81633) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 15 07:09:02 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:09:02 devstack sudo[82567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:09:02 devstack sudo[82567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:09:02 devstack cinder-volume[81465]: DEBUG dbcounter [-] [81465] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=81465) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:09:03 devstack sudo[82567]: pam_unix(sudo:session): session closed for user root Jun 15 07:09:03 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:09:03 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:09:03 devstack sudo[82583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:09:03 devstack sudo[82583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:09:03 devstack sudo[82583]: pam_unix(sudo:session): session closed for user root Jun 15 07:09:03 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:09:03 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:09:03 devstack sudo[82715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:09:03 devstack sudo[82715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:09:04 devstack sudo[82715]: pam_unix(sudo:session): session closed for user root Jun 15 07:09:04 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.597s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:09:04 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:09:04 devstack sudo[82718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:09:04 devstack sudo[82718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:09:04 devstack sudo[82718]: pam_unix(sudo:session): session closed for user root Jun 15 07:09:04 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:09:04 devstack cinder-volume[81633]: INFO cinder.volume.driver [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Driver hasn't implemented _init_vendor_properties() Jun 15 07:09:04 devstack cinder-volume[81633]: DEBUG cinder.volume.driver [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81633) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 15 07:09:04 devstack cinder-volume[81633]: DEBUG oslo_db.sqlalchemy.engines [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81633) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:09:04 devstack cinder-volume[81633]: DEBUG dbcounter [-] [81633] Writer thread running {{(pid=81633) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 15 07:09:04 devstack cinder-volume[81633]: DEBUG cinder.db.sqlalchemy.api [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Building query based on filter {{(pid=81633) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 15 07:09:04 devstack cinder-volume[81633]: DEBUG cinder.image.image_utils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81633) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 15 07:09:04 devstack cinder-volume[81633]: INFO cinder.keymgr.migration [None req-7c105c0c-ed0c-43cb-b679-bf906101198a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 15 07:09:04 devstack cinder-volume[81633]: DEBUG cinder.volume.drivers.lvm [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Updating volume stats {{(pid=81633) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 15 07:09:04 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:09:04 devstack sudo[82722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:09:04 devstack sudo[82722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:09:05 devstack sudo[82722]: pam_unix(sudo:session): session closed for user root Jun 15 07:09:05 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:09:05 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:09:05 devstack sudo[82725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:09:05 devstack sudo[82725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:09:06 devstack sudo[82725]: pam_unix(sudo:session): session closed for user root Jun 15 07:09:06 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:09:06 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:09:06 devstack sudo[82728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:09:06 devstack sudo[82728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:09:06 devstack sudo[82728]: pam_unix(sudo:session): session closed for user root Jun 15 07:09:06 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.613s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:09:06 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:09:06 devstack sudo[82734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:09:06 devstack sudo[82734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:09:07 devstack sudo[82734]: pam_unix(sudo:session): session closed for user root Jun 15 07:09:07 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:09:07 devstack cinder-volume[81633]: DEBUG cinder.manager [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Notifying Schedulers of capabilities ... {{(pid=81633) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:09:07 devstack cinder-volume[81633]: INFO cinder.volume.manager [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Driver initialization completed successfully. Jun 15 07:09:07 devstack cinder-volume[81633]: INFO cinder.manager [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Initiating service 2 cleanup Jun 15 07:09:07 devstack cinder-volume[81633]: INFO cinder.manager [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Service 2 cleanup completed. Jun 15 07:09:07 devstack cinder-volume[81633]: DEBUG cinder.service [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Creating RPC server for service cinder-volume {{(pid=81633) start /opt/stack/cinder/cinder/service.py:231}} Jun 15 07:09:07 devstack cinder-volume[81633]: DEBUG cinder.service [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81633) start /opt/stack/cinder/cinder/service.py:237}} Jun 15 07:09:07 devstack cinder-volume[81633]: INFO cinder.volume.manager [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 15 07:09:07 devstack cinder-volume[81633]: DEBUG cinder.volume.drivers.lvm [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Updating volume stats {{(pid=81633) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 15 07:09:07 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:09:07 devstack sudo[82740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:09:07 devstack sudo[82740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:09:08 devstack sudo[82740]: pam_unix(sudo:session): session closed for user root Jun 15 07:09:08 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:09:08 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:09:08 devstack sudo[82745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:09:08 devstack sudo[82745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:09:08 devstack sudo[82745]: pam_unix(sudo:session): session closed for user root Jun 15 07:09:08 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:09:08 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:09:09 devstack sudo[82749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:09:09 devstack sudo[82749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:09:09 devstack sudo[82749]: pam_unix(sudo:session): session closed for user root Jun 15 07:09:09 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.648s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:09:09 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:09:09 devstack sudo[82809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:09:09 devstack sudo[82809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:09:10 devstack sudo[82809]: pam_unix(sudo:session): session closed for user root Jun 15 07:09:10 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.589s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:09:10 devstack cinder-volume[81633]: INFO cinder.volume.manager [None req-00dae734-4f8a-46c8-8fd8-8036793ae386 None None] Driver post RPC initialization completed successfully. Jun 15 07:09:20 devstack cinder-volume[81633]: DEBUG dbcounter [-] [81633] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=81633) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:09:20 devstack cinder-volume[81633]: DEBUG dbcounter [-] [81633] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=81633) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:09:48 devstack cinder-volume[81633]: DEBUG oslo_service.periodic_task [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running periodic task VolumeManager._thread_info {{(pid=81633) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:09:48 devstack cinder-volume[81633]: DEBUG cinder.volume.manager [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] thread count: 6 {{(pid=81633) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:09:48 devstack cinder-volume[81633]: DEBUG cinder.volume.manager [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] thread info: [<_MainThread(MainThread, started 125387723784320)>, , , , , ] {{(pid=81633) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:10:48 devstack cinder-volume[81633]: DEBUG oslo_service.periodic_task [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81633) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:10:48 devstack cinder-volume[81633]: DEBUG cinder.volume.drivers.lvm [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Updating volume stats {{(pid=81633) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 15 07:10:48 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:10:48 devstack sudo[87600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:10:48 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:10:48 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root Jun 15 07:10:48 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.570s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:10:48 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:10:48 devstack sudo[87604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:10:48 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:10:49 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root Jun 15 07:10:49 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.576s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:10:49 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:10:49 devstack sudo[87612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:10:49 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:10:49 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root Jun 15 07:10:49 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.593s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:10:49 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:10:50 devstack sudo[87657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:10:50 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:10:50 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root Jun 15 07:10:50 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:10:50 devstack cinder-volume[81633]: DEBUG cinder.manager [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Notifying Schedulers of capabilities ... {{(pid=81633) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:10:50 devstack cinder-volume[81633]: DEBUG oslo_service.periodic_task [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running periodic task VolumeManager._thread_info {{(pid=81633) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:10:50 devstack cinder-volume[81633]: DEBUG cinder.volume.manager [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] thread count: 6 {{(pid=81633) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:10:50 devstack cinder-volume[81633]: DEBUG cinder.volume.manager [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] thread info: [<_MainThread(MainThread, started 125387723784320)>, , , , , ] {{(pid=81633) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:11:20 devstack cinder-volume[81633]: DEBUG dbcounter [-] [81633] Writing DB stats cinder:SELECT=1 {{(pid=81633) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:11:20 devstack cinder-volume[81633]: DEBUG dbcounter [-] [81633] Writing DB stats cinder:UPDATE=1 {{(pid=81633) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:11:48 devstack cinder-volume[81633]: DEBUG oslo_service.periodic_task [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81633) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:11:48 devstack cinder-volume[81633]: DEBUG cinder.volume.drivers.lvm [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Updating volume stats {{(pid=81633) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 15 07:11:48 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:11:48 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:11:48 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:11:48 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Jun 15 07:11:48 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.589s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:11:48 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:11:48 devstack sudo[89033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:11:48 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:11:49 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root Jun 15 07:11:49 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.587s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:11:49 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:11:49 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:11:49 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:11:50 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Jun 15 07:11:50 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.613s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:11:50 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:11:50 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:11:50 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:11:50 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Jun 15 07:11:50 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:11:50 devstack cinder-volume[81633]: DEBUG cinder.manager [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Notifying Schedulers of capabilities ... {{(pid=81633) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:11:50 devstack cinder-volume[81633]: DEBUG oslo_service.periodic_task [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running periodic task VolumeManager._thread_info {{(pid=81633) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:11:50 devstack cinder-volume[81633]: DEBUG cinder.volume.manager [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] thread count: 6 {{(pid=81633) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:11:50 devstack cinder-volume[81633]: DEBUG cinder.volume.manager [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] thread info: [<_MainThread(MainThread, started 125387723784320)>, , , , , ] {{(pid=81633) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:12:48 devstack cinder-volume[81633]: DEBUG oslo_service.periodic_task [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81633) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:12:48 devstack cinder-volume[81633]: DEBUG cinder.volume.drivers.lvm [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Updating volume stats {{(pid=81633) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 15 07:12:48 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:12:48 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:12:48 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:12:48 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Jun 15 07:12:48 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.589s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:12:48 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:12:48 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:12:48 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:12:49 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Jun 15 07:12:49 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.567s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:12:49 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:12:49 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:12:49 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:12:49 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Jun 15 07:12:49 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.577s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:12:49 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:12:50 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:12:50 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:12:50 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Jun 15 07:12:50 devstack cinder-volume[81633]: DEBUG oslo_concurrency.processutils [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.600s {{(pid=81633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:12:50 devstack cinder-volume[81633]: DEBUG cinder.manager [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Notifying Schedulers of capabilities ... {{(pid=81633) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:12:50 devstack cinder-volume[81633]: DEBUG oslo_service.periodic_task [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] Running periodic task VolumeManager._thread_info {{(pid=81633) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:12:50 devstack cinder-volume[81633]: DEBUG cinder.volume.manager [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] thread count: 6 {{(pid=81633) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:12:50 devstack cinder-volume[81633]: DEBUG cinder.volume.manager [None req-347989a4-c1f5-4469-a736-389d0a9aa5c7 None None] thread info: [<_MainThread(MainThread, started 125387723784320)>, , , , , ] {{(pid=81633) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:13:20 devstack cinder-volume[81633]: DEBUG dbcounter [-] [81633] Writing DB stats cinder:SELECT=1 {{(pid=81633) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:13:20 devstack cinder-volume[81633]: DEBUG dbcounter [-] [81633] Writing DB stats cinder:UPDATE=1 {{(pid=81633) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:13:25 devstack cinder-volume[81465]: INFO oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Caught SIGTERM, stopping children Jun 15 07:13:25 devstack cinder-volume[81465]: DEBUG oslo_concurrency.lockutils [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Acquiring lock "singleton_lock" {{(pid=81465) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 15 07:13:25 devstack cinder-volume[81465]: DEBUG oslo_concurrency.lockutils [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Acquired lock "singleton_lock" {{(pid=81465) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 15 07:13:25 devstack cinder-volume[81465]: DEBUG oslo_concurrency.lockutils [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Releasing lock "singleton_lock" {{(pid=81465) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 15 07:13:25 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Stop services. {{(pid=81465) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 15 07:13:25 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Killing children. {{(pid=81465) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 15 07:13:25 devstack cinder-volume[81465]: INFO oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Waiting on 1 children to exit Jun 15 07:13:27 devstack cinder-volume[81633]: DEBUG oslo_concurrency.lockutils [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Acquiring lock "singleton_lock" {{(pid=81633) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 15 07:13:27 devstack cinder-volume[81633]: DEBUG oslo_concurrency.lockutils [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Acquired lock "singleton_lock" {{(pid=81633) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 15 07:13:27 devstack cinder-volume[81633]: DEBUG oslo_concurrency.lockutils [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Releasing lock "singleton_lock" {{(pid=81633) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 15 07:13:27 devstack cinder-volume[81633]: WARNING amqp [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 15 07:13:27 devstack cinder-volume[81633]: WARNING amqp [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 15 07:13:27 devstack cinder-volume[81465]: INFO oslo_service.backend._eventlet.service [None req-8c216bde-10a8-421a-a6b7-b89717f48b8d None None] Child 81633 exited with status 0 Jun 15 07:13:29 devstack cinder-volume[91356]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91356) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 15 07:13:29 devstack cinder-volume[91356]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91356) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 15 07:13:29 devstack cinder-volume[91356]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91356) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 15 07:13:30 devstack cinder-volume[91356]: INFO dbcounter [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Registered counter for database cinder Jun 15 07:13:30 devstack cinder-volume[91356]: DEBUG oslo_db.sqlalchemy.engines [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91356) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:13:30 devstack cinder-volume[91356]: DEBUG dbcounter [-] [91356] Writer thread running {{(pid=91356) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 15 07:13:30 devstack cinder-volume[91356]: INFO cinder.rpc [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 15 07:13:30 devstack cinder-volume[91356]: INFO cinder.rpc [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 15 07:13:30 devstack cinder-volume[91356]: DEBUG oslo_db.sqlalchemy.engines [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91356) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:13:30 devstack cinder-volume[91356]: INFO cinder.volume.manager [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Determined volume DB was empty at startup. Jun 15 07:13:30 devstack cinder-volume[91356]: DEBUG cinder.volume.manager [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91356) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 15 07:13:30 devstack cinder-volume[91356]: INFO cinder.volume.manager [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 15 07:13:30 devstack cinder-volume[91356]: WARNING stevedore.named [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 15 07:13:30 devstack cinder-volume[91356]: WARNING castellan.key_manager [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 15 07:13:31 devstack cinder-volume[91356]: WARNING cinder.keymgr.conf_key_mgr [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 15 07:13:31 devstack cinder-volume[91356]: INFO cinder.volume.manager [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_db.sqlalchemy.engines [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91356) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:13:31 devstack cinder-volume[91356]: INFO oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Starting 1 workers Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Started child 91494 {{(pid=91356) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Full set of CONF: {{(pid=91356) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] ******************************************************************************** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Configuration options gathered from: {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] ================================================================================ {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] allow_availability_zone_fallback = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] allow_compression_on_image_upload = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] allowed_direct_url_schemes = [] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] api_rate_limit = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] auth_strategy = keystone {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_availability_zone = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_host = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_name = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91494]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_stats_polling_interval = 60 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backup_api_class = cinder.backup.api.API {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backup_name_template = backup-%s {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backup_use_same_host = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backup_use_temp_snapshot = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] chap_password = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] chap_username = {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cinder_internal_tenant_project_id = f74a69608b7e4161bd24f484b1590383 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cinder_internal_tenant_user_id = 00238d2ae5e24c32b4884292b32cb15d {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cluster = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] compression_format = gzip {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] compute_api_class = cinder.compute.nova.API {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] config_dir = [] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] config_source = [] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] control_exchange = openstack {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] debug = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] default_availability_zone = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] default_group_type = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] default_volume_type = QuobyteHD {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] disk_geometry = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] driver_client_cert = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] driver_client_cert_key = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] driver_data_namespace = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] driver_ssl_cert_path = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] driver_ssl_cert_verify = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] driver_use_ssl = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] enable_new_services = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] enable_unsupported_driver = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] enabled_backends = ['QuobyteHD'] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] enforce_multipath_for_image_xfer = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] filter_function = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance_api_insecure = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance_api_servers = ['http://192.168.122.147/image'] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance_api_ssl_compression = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance_ca_certificates_file = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance_catalog_info = image:glance:publicURL {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance_certfile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance_keyfile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance_num_retries = 3 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance_request_timeout = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] goodness_function = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] graceful_shutdown_timeout = 5 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] group_api_class = cinder.group.api.API {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] host = devstack {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] image_compress_on_upload = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] image_conversion_address_space_limit = 1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] image_conversion_cpu_limit = 60 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] image_conversion_disable = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] image_upload_use_cinder_backend = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] image_upload_use_internal_tenant = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] image_volume_cache_enabled = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] image_volume_cache_max_count = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] image_volume_cache_max_size_gb = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] init_host_max_objects_retrieval = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] instance_format = [instance: %(uuid)s] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] iscsi_target_flags = {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] iscsi_write_cache = on {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] iser_helper = tgtadm {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] iser_ip_address = 192.168.122.147 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] iser_port = 3260 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] log_color = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] log_config_append = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] log_dir = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] log_file = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] log_options = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] log_rotate_interval = 1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] log_rotate_interval_type = days {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] log_rotation_type = none {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] max_age = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] max_logfile_count = 30 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] max_logfile_size_mb = 200 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] max_over_subscription_ratio = 20.0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] message_reap_interval = 86400 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] message_ttl = 2592000 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] migration_create_volume_timeout_secs = 300 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] monkey_patch = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] monkey_patch_modules = [] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] my_ip = 192.168.122.147 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] no_snapshot_gb_quota = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] num_iser_scan_tries = 3 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] num_shell_tries = 3 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] num_volume_device_scan_tries = 3 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] nvmeof_conn_info_version = 1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] nvmet_ns_id = 10 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] nvmet_port_id = 1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] osapi_max_limit = 1000 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] osapi_volume_ext_list = [] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] osapi_volume_listen = 0.0.0.0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] osapi_volume_listen_port = 8776 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] osapi_volume_use_ssl = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] osapi_volume_workers = 2 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] per_volume_size_limit = -1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] periodic_fuzzy_delay = 60 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] periodic_interval = 60 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] project_id_regex = [0-9a-f\-]+ {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] public_endpoint = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] publish_errors = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] quota_backup_gigabytes = 1000 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] quota_backups = 10 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] quota_gigabytes = 1000 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] quota_groups = 10 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] quota_snapshots = 10 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] quota_volumes = 10 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] rate_limit_burst = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] rate_limit_except_level = CRITICAL {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] rate_limit_interval = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] reinit_driver_count = 3 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] replication_device = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] report_discard_supported = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] report_interval = 120 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] reservation_clean_interval = 86400 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] reservation_expire = 86400 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] reserved_image_namespaces = [] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] reserved_percentage = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] rpc_response_timeout = 120 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] run_external_periodic_tasks = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] scst_target_driver = iscsi {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] scst_target_iqn_name = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] service_down_time = 720 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] shell_completion = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] snapshot_name_template = snapshot-%s {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] split_loggers = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] state_path = /opt/stack/data/cinder {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] storage_availability_zone = nova {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] storage_protocol = iSCSI {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] syslog_log_facility = LOG_USER {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] target_helper = lioadm {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] target_ip_address = 192.168.122.147 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] target_port = 3260 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] target_protocol = iscsi {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] target_secondary_ip_addresses = [] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] trace_flags = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] transfer_api_class = cinder.transfer.api.API {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] transport_url = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] until_refresh = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] use_chap_auth = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] use_default_quota_class = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] use_journal = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] use_json = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] use_multipath_for_image_xfer = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] use_stderr = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] use_syslog = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] verify_glance_signatures = enabled {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] volume_api_class = cinder.volume.api.API {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] volume_backend_name = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] volume_clear = zero {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] volume_clear_ionice = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] volume_clear_size = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] volume_copy_bps_limit = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] volume_dd_blocksize = 1M {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] volume_name_template = volume-%s {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] volume_service_inithost_offload = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] volume_usage_audit_period = month {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] zoning_mode = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_concurrency.disable_process_locking = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.admin_password = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.admin_token = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.admin_user = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.auth_admin_prefix = {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91494]: INFO cinder.volume.manager [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.auth_port = 35357 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.auth_protocol = https {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.auth_section = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.auth_type = password {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.auth_uri = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.auth_version = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.cache = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.certfile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.delay_auth_decision = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.http_connect_timeout = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91494]: DEBUG cinder.volume.drivers.remotefs [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=91494) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.identity_uri = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.include_service_catalog = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.insecure = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.interface = public {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.keyfile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.memcache_password = {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.memcache_username = {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.region_name = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.service_token_roles_required = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.service_type = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.token_cache_time = 300 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.147/identity {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.backend = dogpile.cache.null {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.backend_argument = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.backend_expiration_time = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.config_prefix = cache.oslo {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.debug_cache_backend = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.enable_retry_client = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.enable_socket_keepalive = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.enabled = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.enforce_fips_mode = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.expiration_time = 600 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.hashclient_retry_attempts = 2 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.memcache_dead_retry = 300 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.memcache_pool_maxsize = 10 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.memcache_sasl_enabled = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.password = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.proxies = [] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.redis_db = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.redis_sentinel_service_name = mymaster {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.redis_server = localhost:6379 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.retry_attempts = 2 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.retry_delay = 0.0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.socket_keepalive_count = 1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.socket_keepalive_idle = 1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.socket_keepalive_interval = 1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.socket_timeout = 1.0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.tls_allowed_ciphers = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.tls_cafile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.tls_certfile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.tls_enabled = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.tls_keyfile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cache.username = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.asyncio_connection = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.asyncio_slave_connection = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.backend = sqlalchemy {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.connection = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.connection_debug = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.connection_parameters = {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.connection_recycle_time = 3600 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.connection_trace = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.db_inc_retry_interval = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.db_max_retries = 20 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.db_max_retry_interval = 10 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.db_retry_interval = 1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.max_overflow = 50 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.max_pool_size = 5 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.max_retries = 10 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.mysql_wsrep_sync_wait = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.pool_timeout = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.retry_interval = 10 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.slave_connection = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.sqlite_synchronous = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.synchronous_reader = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] database.use_db_reconnect = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] profiler.connection_string = messaging:// {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] profiler.enabled = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] profiler.es_doc_type = notification {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] profiler.es_scroll_size = 10000 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] profiler.es_scroll_time = 2m {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] profiler.filter_error_trace = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] profiler.hmac_keys = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] profiler.sentinel_service_name = mymaster {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] profiler.socket_timeout = 0.1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] profiler.trace_requests = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] profiler.trace_sqlalchemy = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] profiler_jaeger.process_tags = {} {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] profiler_jaeger.service_name_prefix = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] profiler_otlp.service_name_prefix = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_policy.enforce_new_defaults = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: WARNING oslo_config.cfg [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_policy.enforce_scope = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_policy.policy_default_rule = default {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_policy.policy_file = policy.yaml {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_policy.remote_timeout = 60.0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] coordination.backend_url = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] privsep_osbrick.group = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] privsep_osbrick.helper_command = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] privsep_osbrick.user = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cinder_sys_admin.group = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cinder_sys_admin.helper_command = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] cinder_sys_admin.user = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] service_user.auth_section = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] service_user.auth_type = password {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] service_user.cafile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] service_user.certfile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] service_user.collect_timing = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] service_user.insecure = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] service_user.keyfile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] service_user.send_service_user_token = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] service_user.split_loggers = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] service_user.timeout = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance.auth_section = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance.auth_type = password {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance.certfile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance.collect_timing = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance.insecure = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance.keyfile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance.region_name = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance.split_loggers = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] glance.timeout = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.backend_availability_zone = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.chap_password = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.chap_username = {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.disk_geometry = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.driver_client_cert = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.driver_client_cert_key = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.driver_data_namespace = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.driver_use_ssl = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.enable_unsupported_driver = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.extra_capabilities = {} {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.filter_function = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.goodness_function = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.iscsi_target_flags = {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.iscsi_write_cache = on {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.iser_helper = tgtadm {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.iser_ip_address = 192.168.122.147 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.iser_port = 3260 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.nas_host = {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.nas_login = admin {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.nas_mount_options = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.nas_password = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.nas_private_key = {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.nas_share_path = {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.nas_ssh_port = 22 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.num_shell_tries = 3 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.nvmet_port_id = 1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.quobyte_client_cfg = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.quobyte_volume_url = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.replication_device = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.report_discard_supported = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.reserved_percentage = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.scst_target_driver = iscsi {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.scst_target_iqn_name = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.storage_protocol = iSCSI {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.target_helper = tgtadm {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.target_ip_address = 192.168.122.147 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.target_port = 3260 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.target_protocol = iscsi {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.trace_flags = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.unique_fqdn_network = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.use_chap_auth = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.volume_backend_name = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.volume_clear = zero {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.volume_clear_ionice = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.volume_clear_size = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_reports.file_event_handler = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack quobyte-client[91575]: Reading configuration file: /etc/quobyte/client.cfg Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_reports.log_dir = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.backend_availability_zone = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.backend_host = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.chap_password = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack quobyte-client[91575]: Invalid parameters found, error: missing mount point. Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.chap_username = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.chiscsi_conf = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.disk_geometry = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.driver_client_cert = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.driver_client_cert_key = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack quobyte-client[91575]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 15 07:13:31 devstack cinder-volume[91494]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=91494) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 15 07:13:31 devstack cinder-volume[91494]: WARNING cinder.volume.drivers.quobyte [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 15 07:13:31 devstack cinder-volume[91494]: WARNING cinder.volume.drivers.quobyte [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 15 07:13:31 devstack quobyte-client[91575]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.driver_data_namespace = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.driver_use_ssl = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91494]: DEBUG oslo_concurrency.processutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Running cmd (subprocess): mount.quobyte {{(pid=91494) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.extra_capabilities = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.filter_function = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.goodness_function = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.iscsi_target_flags = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.iscsi_write_cache = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.iser_helper = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.iser_ip_address = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.iser_port = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.iser_target_prefix = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.nas_host = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.nas_login = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.nas_mount_options = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.nas_password = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.nas_private_key = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.nas_share_path = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.nas_ssh_port = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.num_shell_tries = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.nvmet_ns_id = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.nvmet_port_id = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.replication_device = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.report_discard_supported = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.reserved_percentage = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.scst_target_driver = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.storage_protocol = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.target_helper = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.target_ip_address = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.target_port = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.target_prefix = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.target_protocol = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.trace_flags = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.unique_fqdn_network = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.use_chap_auth = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.volume_clear = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.volume_clear_ionice = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.volume_clear_size = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] QuobyteHD.volumes_dir = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.ssl = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.ssl_version = {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_notifications.driver = [] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_notifications.retry = -1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] oslo_messaging_notifications.transport_url = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] key_manager.fixed_key = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican.barbican_api_version = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican.barbican_endpoint = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican.barbican_endpoint_type = public {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican.barbican_region_name = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican.cafile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican.certfile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican.collect_timing = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican.insecure = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican.keyfile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican.number_of_retries = 60 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican.retry_delay = 1 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican.send_service_user_token = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican.split_loggers = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican.timeout = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican.verify_ssl = True {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican.verify_ssl_path = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican_service_user.auth_section = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican_service_user.auth_type = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican_service_user.cafile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican_service_user.certfile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican_service_user.collect_timing = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican_service_user.insecure = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican_service_user.keyfile = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican_service_user.split_loggers = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] barbican_service_user.timeout = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] vault.approle_role_id = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] vault.approle_secret_id = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] vault.kv_mountpoint = secret {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] vault.kv_path = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] vault.kv_version = 2 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] vault.namespace = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] vault.root_token_id = **** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] vault.ssl_ca_crt_file = None {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] vault.timeout = 60.0 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] vault.use_ssl = False {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:31 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] ******************************************************************************** {{(pid=91356) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 15 07:13:31 devstack cinder-volume[91494]: DEBUG oslo_concurrency.processutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=91494) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:31 devstack cinder-volume[91494]: DEBUG oslo_concurrency.lockutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91494) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:13:31 devstack cinder-volume[91494]: DEBUG oslo_concurrency.lockutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91494) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:13:31 devstack cinder-volume[91494]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=91494) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:13:31 devstack cinder-volume[91494]: INFO cinder.volume.drivers.quobyte [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b ... Jun 15 07:13:31 devstack cinder-volume[91494]: DEBUG oslo_concurrency.processutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b -c /etc/quobyte/client-cinder.cfg {{(pid=91494) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:31 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b -c /etc/quobyte/client-cinder.cfg Jun 15 07:13:31 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:32 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:32 devstack cinder-volume[91494]: DEBUG oslo_concurrency.processutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.749s {{(pid=91494) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:32 devstack cinder-volume[91494]: INFO cinder.volume.drivers.quobyte [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b succeeded Jun 15 07:13:32 devstack cinder-volume[91494]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=91494) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:13:32 devstack cinder-volume[91494]: DEBUG oslo_concurrency.lockutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.764s {{(pid=91494) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:13:32 devstack cinder-volume[91494]: DEBUG oslo_concurrency.processutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=91494) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:32 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:13:32 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:32 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:32 devstack cinder-volume[91494]: DEBUG oslo_concurrency.processutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.559s {{(pid=91494) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:32 devstack cinder-volume[91494]: INFO cinder.volume.driver [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Driver hasn't implemented _init_vendor_properties() Jun 15 07:13:32 devstack cinder-volume[91494]: DEBUG cinder.volume.driver [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578430175781, 'free_capacity_gb': 1775.7578430175781, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91494) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 15 07:13:32 devstack cinder-volume[91494]: DEBUG oslo_db.sqlalchemy.engines [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91494) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:13:32 devstack cinder-volume[91494]: DEBUG dbcounter [-] [91494] Writer thread running {{(pid=91494) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 15 07:13:32 devstack cinder-volume[91494]: DEBUG cinder.db.sqlalchemy.api [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Building query based on filter {{(pid=91494) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 15 07:13:32 devstack cinder-volume[91494]: DEBUG cinder.image.image_utils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=91494) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 15 07:13:32 devstack cinder-volume[91494]: INFO cinder.keymgr.migration [None req-24456f65-03ec-4e99-b032-8e0bae7da697 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 15 07:13:32 devstack cinder-volume[91494]: DEBUG oslo_concurrency.lockutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91494) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:13:32 devstack cinder-volume[91494]: DEBUG oslo_concurrency.lockutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91494) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:13:32 devstack cinder-volume[91494]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=91494) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:13:32 devstack cinder-volume[91494]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=91494) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:13:32 devstack cinder-volume[91494]: DEBUG oslo_concurrency.lockutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91494) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:13:32 devstack cinder-volume[91494]: DEBUG oslo_concurrency.processutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=91494) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:32 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:13:32 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:33 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:33 devstack cinder-volume[91494]: DEBUG oslo_concurrency.processutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.552s {{(pid=91494) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:33 devstack cinder-volume[91494]: DEBUG cinder.manager [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Notifying Schedulers of capabilities ... {{(pid=91494) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:13:33 devstack cinder-volume[91494]: INFO cinder.volume.manager [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Driver initialization completed successfully. Jun 15 07:13:33 devstack cinder-volume[91494]: INFO cinder.manager [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Initiating service 3 cleanup Jun 15 07:13:33 devstack cinder-volume[91494]: INFO cinder.manager [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Service 3 cleanup completed. Jun 15 07:13:33 devstack cinder-volume[91494]: DEBUG cinder.service [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Creating RPC server for service cinder-volume {{(pid=91494) start /opt/stack/cinder/cinder/service.py:231}} Jun 15 07:13:33 devstack cinder-volume[91494]: DEBUG cinder.service [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=91494) start /opt/stack/cinder/cinder/service.py:237}} Jun 15 07:13:33 devstack cinder-volume[91494]: INFO cinder.volume.manager [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 15 07:13:33 devstack cinder-volume[91494]: DEBUG oslo_concurrency.lockutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91494) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:13:33 devstack cinder-volume[91494]: DEBUG oslo_concurrency.lockutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91494) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:13:33 devstack cinder-volume[91494]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=91494) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:13:33 devstack cinder-volume[91494]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=91494) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:13:33 devstack cinder-volume[91494]: DEBUG oslo_concurrency.lockutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91494) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:13:33 devstack cinder-volume[91494]: DEBUG oslo_concurrency.processutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=91494) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:33 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:13:33 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:34 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:34 devstack cinder-volume[91494]: DEBUG oslo_concurrency.processutils [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.598s {{(pid=91494) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:34 devstack cinder-volume[91494]: INFO cinder.volume.manager [None req-a7e7039e-a4c2-477b-a09a-df8ce0ac0617 None None] Driver post RPC initialization completed successfully. Jun 15 07:13:38 devstack cinder-volume[91494]: DEBUG oslo_concurrency.lockutils [None req-15b694b6-f3fb-4305-ba6f-28840a27e0b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91494) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:13:38 devstack cinder-volume[91494]: DEBUG oslo_concurrency.lockutils [None req-15b694b6-f3fb-4305-ba6f-28840a27e0b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91494) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:13:38 devstack cinder-volume[91494]: DEBUG cinder.volume.drivers.quobyte [None req-15b694b6-f3fb-4305-ba6f-28840a27e0b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=91494) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:13:38 devstack cinder-volume[91494]: DEBUG cinder.volume.drivers.quobyte [None req-15b694b6-f3fb-4305-ba6f-28840a27e0b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=91494) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:13:38 devstack cinder-volume[91494]: DEBUG oslo_concurrency.lockutils [None req-15b694b6-f3fb-4305-ba6f-28840a27e0b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91494) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:13:38 devstack cinder-volume[91494]: DEBUG oslo_concurrency.processutils [None req-15b694b6-f3fb-4305-ba6f-28840a27e0b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=91494) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:38 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:13:38 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:38 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:38 devstack cinder-volume[91494]: DEBUG oslo_concurrency.processutils [None req-15b694b6-f3fb-4305-ba6f-28840a27e0b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.615s {{(pid=91494) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:38 devstack cinder-volume[91494]: DEBUG cinder.manager [None req-15b694b6-f3fb-4305-ba6f-28840a27e0b3 None None] Notifying Schedulers of capabilities ... {{(pid=91494) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:13:39 devstack cinder-volume[91356]: INFO oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Caught SIGTERM, stopping children Jun 15 07:13:39 devstack cinder-volume[91356]: DEBUG oslo_concurrency.lockutils [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Acquiring lock "singleton_lock" {{(pid=91356) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 15 07:13:39 devstack cinder-volume[91356]: DEBUG oslo_concurrency.lockutils [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Acquired lock "singleton_lock" {{(pid=91356) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 15 07:13:39 devstack cinder-volume[91356]: DEBUG oslo_concurrency.lockutils [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Releasing lock "singleton_lock" {{(pid=91356) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 15 07:13:39 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Stop services. {{(pid=91356) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 15 07:13:39 devstack cinder-volume[91356]: DEBUG oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Killing children. {{(pid=91356) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 15 07:13:39 devstack cinder-volume[91356]: INFO oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Waiting on 1 children to exit Jun 15 07:13:41 devstack cinder-volume[91494]: DEBUG oslo_concurrency.lockutils [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Acquiring lock "singleton_lock" {{(pid=91494) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 15 07:13:41 devstack cinder-volume[91494]: DEBUG oslo_concurrency.lockutils [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Acquired lock "singleton_lock" {{(pid=91494) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 15 07:13:41 devstack cinder-volume[91494]: DEBUG oslo_concurrency.lockutils [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Releasing lock "singleton_lock" {{(pid=91494) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 15 07:13:41 devstack cinder-volume[91494]: WARNING amqp [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 15 07:13:41 devstack cinder-volume[91494]: WARNING amqp [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 15 07:13:41 devstack cinder-volume[91356]: INFO oslo_service.backend._eventlet.service [None req-90f56d66-ab56-48d6-9a64-821e39254445 None None] Child 91494 exited with status 0 Jun 15 07:13:45 devstack cinder-volume[91852]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91852) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 15 07:13:45 devstack cinder-volume[91852]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91852) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 15 07:13:45 devstack cinder-volume[91852]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91852) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 15 07:13:46 devstack cinder-volume[91852]: INFO dbcounter [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] Registered counter for database cinder Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_db.sqlalchemy.engines [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91852) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG dbcounter [-] [91852] Writer thread running {{(pid=91852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 15 07:13:46 devstack cinder-volume[91852]: INFO cinder.rpc [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 15 07:13:46 devstack cinder-volume[91852]: INFO cinder.rpc [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_db.sqlalchemy.engines [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91852) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:13:46 devstack cinder-volume[91852]: INFO cinder.volume.manager [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] Determined volume DB was empty at startup. Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG cinder.volume.manager [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91852) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 15 07:13:46 devstack cinder-volume[91852]: WARNING stevedore.named [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 15 07:13:46 devstack cinder-volume[91852]: WARNING castellan.key_manager [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 15 07:13:46 devstack cinder-volume[91852]: WARNING cinder.keymgr.conf_key_mgr [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 15 07:13:46 devstack cinder-volume[91852]: INFO cinder.volume.manager [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_db.sqlalchemy.engines [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91852) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:13:46 devstack cinder-volume[91852]: INFO oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] Starting 1 workers Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] Started child 92129 {{(pid=91852) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] Full set of CONF: {{(pid=91852) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] ******************************************************************************** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] Configuration options gathered from: {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] ================================================================================ {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 15 07:13:46 devstack cinder-volume[92129]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] allow_availability_zone_fallback = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] allow_compression_on_image_upload = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] allowed_direct_url_schemes = [] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] api_rate_limit = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] auth_strategy = keystone {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_availability_zone = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_host = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_name = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_stats_polling_interval = 60 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backup_api_class = cinder.backup.api.API {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backup_name_template = backup-%s {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backup_use_same_host = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backup_use_temp_snapshot = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] chap_password = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] chap_username = {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cinder_internal_tenant_project_id = f74a69608b7e4161bd24f484b1590383 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cinder_internal_tenant_user_id = 00238d2ae5e24c32b4884292b32cb15d {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cluster = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] compression_format = gzip {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] compute_api_class = cinder.compute.nova.API {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] config_dir = [] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] config_source = [] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] control_exchange = openstack {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] debug = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] default_availability_zone = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] default_group_type = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] default_volume_type = QuobyteHD {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] disk_geometry = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] driver_client_cert = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] driver_client_cert_key = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] driver_data_namespace = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] driver_ssl_cert_path = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] driver_ssl_cert_verify = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] driver_use_ssl = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] enable_new_services = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] enable_unsupported_driver = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] enabled_backends = ['QuobyteHD'] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] enforce_multipath_for_image_xfer = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] filter_function = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance_api_insecure = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance_api_servers = ['http://192.168.122.147/image'] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance_api_ssl_compression = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance_ca_certificates_file = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance_catalog_info = image:glance:publicURL {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance_certfile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance_keyfile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance_num_retries = 3 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance_request_timeout = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] goodness_function = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] graceful_shutdown_timeout = 5 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] group_api_class = cinder.group.api.API {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] host = devstack {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] image_compress_on_upload = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] image_conversion_address_space_limit = 1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Starting volume driver QuobyteDriver (1.1.14) Jun 15 07:13:46 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92129) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] image_conversion_cpu_limit = 60 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] image_conversion_disable = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] image_upload_use_cinder_backend = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] image_upload_use_internal_tenant = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] image_volume_cache_enabled = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] image_volume_cache_max_count = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] image_volume_cache_max_size_gb = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] init_host_max_objects_retrieval = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] instance_format = [instance: %(uuid)s] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] iscsi_target_flags = {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] iscsi_write_cache = on {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] iser_helper = tgtadm {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] iser_ip_address = 192.168.122.147 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] iser_port = 3260 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] log_color = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] log_config_append = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] log_dir = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] log_file = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] log_options = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] log_rotate_interval = 1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] log_rotate_interval_type = days {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] log_rotation_type = none {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] max_age = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] max_logfile_count = 30 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] max_logfile_size_mb = 200 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] max_over_subscription_ratio = 20.0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] message_reap_interval = 86400 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] message_ttl = 2592000 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] migration_create_volume_timeout_secs = 300 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] monkey_patch = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] monkey_patch_modules = [] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] my_ip = 192.168.122.147 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] no_snapshot_gb_quota = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] num_iser_scan_tries = 3 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] num_shell_tries = 3 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] num_volume_device_scan_tries = 3 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] nvmeof_conn_info_version = 1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] nvmet_ns_id = 10 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] nvmet_port_id = 1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] osapi_max_limit = 1000 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] osapi_volume_ext_list = [] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] osapi_volume_listen = 0.0.0.0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] osapi_volume_listen_port = 8776 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] osapi_volume_use_ssl = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] osapi_volume_workers = 2 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] per_volume_size_limit = -1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] periodic_fuzzy_delay = 60 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] periodic_interval = 60 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] project_id_regex = [0-9a-f\-]+ {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] public_endpoint = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] publish_errors = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] quota_backup_gigabytes = 1000 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] quota_backups = 10 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] quota_gigabytes = 1000 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] quota_groups = 10 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] quota_snapshots = 10 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] quota_volumes = 10 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] rate_limit_burst = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] rate_limit_except_level = CRITICAL {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] rate_limit_interval = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] reinit_driver_count = 3 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] replication_device = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] report_discard_supported = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] report_interval = 120 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] reservation_clean_interval = 86400 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] reservation_expire = 86400 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] reserved_image_namespaces = [] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] reserved_percentage = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] rpc_response_timeout = 120 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] run_external_periodic_tasks = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] scst_target_driver = iscsi {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] scst_target_iqn_name = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] service_down_time = 720 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] shell_completion = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] snapshot_name_template = snapshot-%s {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] split_loggers = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] state_path = /opt/stack/data/cinder {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] storage_availability_zone = nova {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] storage_protocol = iSCSI {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] syslog_log_facility = LOG_USER {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] target_helper = lioadm {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] target_ip_address = 192.168.122.147 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] target_port = 3260 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] target_protocol = iscsi {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] target_secondary_ip_addresses = [] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] trace_flags = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] transfer_api_class = cinder.transfer.api.API {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] transport_url = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] until_refresh = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] use_chap_auth = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] use_default_quota_class = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] use_journal = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] use_json = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] use_multipath_for_image_xfer = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] use_stderr = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] use_syslog = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] verify_glance_signatures = enabled {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] volume_api_class = cinder.volume.api.API {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] volume_backend_name = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] volume_clear = zero {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] volume_clear_ionice = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] volume_clear_size = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] volume_copy_bps_limit = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] volume_dd_blocksize = 1M {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92129) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] volume_name_template = volume-%s {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.quobyte [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] volume_service_inithost_offload = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] volume_usage_audit_period = month {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] zoning_mode = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_concurrency.disable_process_locking = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.quobyte [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Running cmd (subprocess): mount.quobyte {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.admin_password = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.admin_token = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.admin_user = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.auth_admin_prefix = {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.auth_port = 35357 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.auth_protocol = https {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.auth_section = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.auth_type = password {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.auth_uri = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.auth_version = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.cache = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.certfile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.delay_auth_decision = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.http_connect_timeout = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.identity_uri = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.include_service_catalog = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.insecure = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.interface = public {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.keyfile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.memcache_password = {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.memcache_username = {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.region_name = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.service_token_roles_required = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.service_type = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.token_cache_time = 300 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.147/identity {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.backend = dogpile.cache.null {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.backend_argument = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.backend_expiration_time = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.config_prefix = cache.oslo {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.debug_cache_backend = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.enable_retry_client = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.enable_socket_keepalive = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.enabled = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.enforce_fips_mode = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.expiration_time = 600 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.hashclient_retry_attempts = 2 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.memcache_dead_retry = 300 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.memcache_pool_maxsize = 10 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.memcache_sasl_enabled = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.password = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.proxies = [] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.redis_db = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.redis_sentinel_service_name = mymaster {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.redis_server = localhost:6379 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.retry_attempts = 2 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.retry_delay = 0.0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.socket_keepalive_count = 1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.socket_keepalive_idle = 1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.socket_keepalive_interval = 1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.socket_timeout = 1.0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.tls_allowed_ciphers = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.tls_cafile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.tls_certfile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.tls_enabled = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.tls_keyfile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cache.username = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.asyncio_connection = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.asyncio_slave_connection = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.backend = sqlalchemy {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.connection = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.connection_debug = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.connection_parameters = {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.connection_recycle_time = 3600 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.connection_trace = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.db_inc_retry_interval = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.db_max_retries = 20 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.db_max_retry_interval = 10 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.db_retry_interval = 1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.max_overflow = 50 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.max_pool_size = 5 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.max_retries = 10 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.mysql_wsrep_sync_wait = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.pool_timeout = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.retry_interval = 10 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.slave_connection = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.sqlite_synchronous = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.synchronous_reader = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] database.use_db_reconnect = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] profiler.connection_string = messaging:// {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] profiler.enabled = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] profiler.es_doc_type = notification {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack quobyte-client[92130]: Reading configuration file: /etc/quobyte/client.cfg Jun 15 07:13:46 devstack quobyte-client[92130]: Invalid parameters found, error: missing mount point. Jun 15 07:13:46 devstack quobyte-client[92130]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 15 07:13:46 devstack quobyte-client[92130]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] profiler.es_scroll_size = 10000 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] profiler.es_scroll_time = 2m {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] profiler.filter_error_trace = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] profiler.hmac_keys = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] profiler.sentinel_service_name = mymaster {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] profiler.socket_timeout = 0.1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] profiler.trace_requests = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] CMD "mount.quobyte" returned: 1 in 0.075s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] profiler.trace_sqlalchemy = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] profiler_jaeger.process_tags = {} {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] profiler_jaeger.service_name_prefix = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] profiler_otlp.service_name_prefix = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_policy.enforce_new_defaults = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: WARNING oslo_config.cfg [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_policy.enforce_scope = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_policy.policy_default_rule = default {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_policy.policy_file = policy.yaml {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_policy.remote_timeout = 60.0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] coordination.backend_url = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] privsep_osbrick.group = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] privsep_osbrick.helper_command = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] privsep_osbrick.user = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cinder_sys_admin.group = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cinder_sys_admin.helper_command = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] cinder_sys_admin.user = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] service_user.auth_section = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] service_user.auth_type = password {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] service_user.cafile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] service_user.certfile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] service_user.collect_timing = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] service_user.insecure = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] service_user.keyfile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] service_user.send_service_user_token = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] service_user.split_loggers = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] service_user.timeout = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance.auth_section = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance.auth_type = password {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance.certfile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance.collect_timing = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance.insecure = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance.keyfile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance.region_name = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance.split_loggers = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] glance.timeout = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.backend_availability_zone = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.chap_password = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.chap_username = {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.disk_geometry = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.driver_client_cert = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.driver_client_cert_key = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.driver_data_namespace = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.driver_use_ssl = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.enable_unsupported_driver = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.extra_capabilities = {} {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.filter_function = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.goodness_function = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.iscsi_target_flags = {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.iscsi_write_cache = on {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.iser_helper = tgtadm {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.iser_ip_address = 192.168.122.147 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.iser_port = 3260 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.nas_host = {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.nas_login = admin {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.nas_mount_options = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.nas_password = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.nas_private_key = {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.nas_share_path = {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.nas_ssh_port = 22 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.num_shell_tries = 3 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack sudo[92131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.nvmet_port_id = 1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.quobyte_client_cfg = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.quobyte_volume_url = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.replication_device = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.report_discard_supported = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.reserved_percentage = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.scst_target_driver = iscsi {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.scst_target_iqn_name = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.storage_protocol = iSCSI {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.target_helper = tgtadm {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.target_ip_address = 192.168.122.147 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.target_port = 3260 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.target_protocol = iscsi {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.trace_flags = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.unique_fqdn_network = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.use_chap_auth = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.volume_backend_name = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.volume_clear = zero {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.volume_clear_ionice = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.volume_clear_size = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_reports.file_event_handler = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_reports.log_dir = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.backend_availability_zone = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.backend_host = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.chap_password = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.chap_username = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.chiscsi_conf = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.disk_geometry = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.driver_client_cert = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.driver_client_cert_key = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.driver_data_namespace = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.driver_use_ssl = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.extra_capabilities = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.filter_function = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.goodness_function = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.iscsi_target_flags = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.iscsi_write_cache = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.iser_helper = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.iser_ip_address = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.iser_port = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.iser_target_prefix = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.nas_host = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.nas_login = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.nas_mount_options = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.nas_password = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.nas_private_key = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.nas_share_path = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.nas_ssh_port = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.num_shell_tries = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.nvmet_ns_id = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.nvmet_port_id = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.replication_device = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.report_discard_supported = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.reserved_percentage = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.scst_target_driver = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.storage_protocol = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.target_helper = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.target_ip_address = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.target_port = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.target_prefix = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.target_protocol = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.trace_flags = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.unique_fqdn_network = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.use_chap_auth = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.volume_clear = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.volume_clear_ionice = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.volume_clear_size = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] QuobyteHD.volumes_dir = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.ssl = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.ssl_version = {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_notifications.driver = [] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_notifications.retry = -1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] oslo_messaging_notifications.transport_url = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] key_manager.fixed_key = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican.barbican_api_version = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican.barbican_endpoint = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican.barbican_endpoint_type = public {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican.barbican_region_name = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican.cafile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican.certfile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican.collect_timing = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican.insecure = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican.keyfile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican.number_of_retries = 60 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican.retry_delay = 1 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican.send_service_user_token = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican.split_loggers = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican.timeout = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican.verify_ssl = True {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican.verify_ssl_path = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican_service_user.auth_section = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican_service_user.auth_type = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican_service_user.cafile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican_service_user.certfile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican_service_user.collect_timing = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican_service_user.insecure = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican_service_user.keyfile = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican_service_user.split_loggers = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] barbican_service_user.timeout = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] vault.approle_role_id = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] vault.approle_secret_id = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] vault.kv_mountpoint = secret {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] vault.kv_path = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] vault.kv_version = 2 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] vault.namespace = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] vault.root_token_id = **** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] vault.ssl_ca_crt_file = None {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] vault.timeout = 60.0 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] vault.use_ssl = False {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:46 devstack cinder-volume[91852]: DEBUG oslo_service.backend._eventlet.service [None req-a4f05786-5f63-46ae-be8f-2079a6333d8d None None] ******************************************************************************** {{(pid=91852) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 15 07:13:47 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.607s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:47 devstack cinder-volume[92129]: INFO cinder.volume.driver [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Driver hasn't implemented _init_vendor_properties() Jun 15 07:13:47 devstack cinder-volume[92129]: DEBUG cinder.volume.driver [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578430175781, 'free_capacity_gb': 1775.7578430175781, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92129) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 15 07:13:47 devstack cinder-volume[92129]: DEBUG oslo_db.sqlalchemy.engines [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92129) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:13:47 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writer thread running {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 15 07:13:47 devstack cinder-volume[92129]: DEBUG cinder.db.sqlalchemy.api [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Building query based on filter {{(pid=92129) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 15 07:13:47 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92129) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 15 07:13:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:13:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:13:47 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:13:47 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:13:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:13:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:47 devstack cinder-volume[92129]: INFO cinder.keymgr.migration [None req-6c597e04-8521-424f-a1d3-d1e85ee487d6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 15 07:13:47 devstack sudo[92150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:13:47 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:48 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.623s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:48 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:13:48 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Driver initialization completed successfully. Jun 15 07:13:48 devstack cinder-volume[92129]: INFO cinder.manager [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Initiating service 3 cleanup Jun 15 07:13:48 devstack cinder-volume[92129]: INFO cinder.manager [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Service 3 cleanup completed. Jun 15 07:13:48 devstack cinder-volume[92129]: DEBUG cinder.service [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Creating RPC server for service cinder-volume {{(pid=92129) start /opt/stack/cinder/cinder/service.py:231}} Jun 15 07:13:48 devstack cinder-volume[92129]: DEBUG cinder.service [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92129) start /opt/stack/cinder/cinder/service.py:237}} Jun 15 07:13:48 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 15 07:13:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:13:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:13:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:13:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:13:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:13:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:48 devstack sudo[92164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:13:48 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:48 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.582s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:48 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c2f67278-6fb9-4183-a874-654747d849fa None None] Driver post RPC initialization completed successfully. Jun 15 07:13:56 devstack cinder-volume[91852]: DEBUG dbcounter [-] [91852] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=91852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:13:58 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:13:58 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=3 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:14:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:14:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 6 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:14:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:14:46 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Flow 'volume_create_manager' (e2c61956-8177-455f-a8dd-eec7603bcf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe72ded-1756-4ea6-9a7f-98b0cf66c8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe72ded-1756-4ea6-9a7f-98b0cf66c8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-120554428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d1e5a1-df95-46e3-9c71-b5ce59a44ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579306bd608c43d3b70a8c8c09bbdccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:14:47Z,use_quota=True,user_id='ffa89b3c9cc649c68d2a35b30861d9a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c53c356-a623-4728-92df-28c3e2fb9e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c53c356-a623-4728-92df-28c3e2fb9e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc5bcf1e-3c15-476a-ab12-4bd5642e553c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc5bcf1e-3c15-476a-ab12-4bd5642e553c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54d1e5a1-df95-46e3-9c71-b5ce59a44ede', 'volume_name': 'volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b707e3ef-b859-4ea3-9af2-3a104d253ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b707e3ef-b859-4ea3-9af2-3a104d253ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1fc0c1-dfcc-4e0c-9146-26a69591503f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:14:47 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Volume 54d1e5a1-df95-46e3-9c71-b5ce59a44ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede', 'volume_size': 1} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-120554428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d1e5a1-df95-46e3-9c71-b5ce59a44ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579306bd608c43d3b70a8c8c09bbdccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:14:47Z,use_quota=True,user_id='ffa89b3c9cc649c68d2a35b30861d9a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Creating volume 54d1e5a1-df95-46e3-9c71-b5ce59a44ede {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:14:47 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:14:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:14:47 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede 1073741824 Jun 15 07:14:47 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:14:48 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Jun 15 07:14:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede 1073741824" returned: 0 in 1.042s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:14:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:14:48 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede Jun 15 07:14:48 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:14:48 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Jun 15 07:14:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede" returned: 0 in 0.723s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:14:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:14:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:14:48 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1fc0c1-dfcc-4e0c-9146-26a69591503f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:14:48 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5decd215-e99c-460b-8eaf-a6a13f371e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:14:49 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Volume volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede (54d1e5a1-df95-46e3-9c71-b5ce59a44ede): created successfully Jun 15 07:14:49 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5decd215-e99c-460b-8eaf-a6a13f371e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:14:49 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Flow 'volume_create_manager' (e2c61956-8177-455f-a8dd-eec7603bcf5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:14:49 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-09a417d0-6940-4ac9-a6a0-c969822adeca tempest-TaggedAttachmentsTest-899565810 None] Created volume successfully. Jun 15 07:14:59 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:14:59 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:15:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:15:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:15:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:15:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:15:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:15:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:15:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:15:13 devstack sudo[93084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:15:13 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:15:15 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root Jun 15 07:15:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.918s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:15:15 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:15:15 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:15:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 6 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:15:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:15:17 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:15:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Flow 'volume_create_manager' (53595cfb-64b4-4e33-b02a-be4b08b0fc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:15:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22813036-36b0-4c7d-8b24-7106c1c109bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22813036-36b0-4c7d-8b24-7106c1c109bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-573810323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f8231c-467d-4a8b-a90e-a32fbff8dd45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7716d166f8e24daf85cd3a0cb4d6fb03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:15:18Z,use_quota=True,user_id='121d77768e1e415d978044f5681473e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f207e07-ce26-47ed-82a2-7bc77012735d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f207e07-ce26-47ed-82a2-7bc77012735d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c837999-567b-41f0-b548-85684f548a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c837999-567b-41f0-b548-85684f548a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5f8231c-467d-4a8b-a90e-a32fbff8dd45', 'volume_name': 'volume-f5f8231c-467d-4a8b-a90e-a32fbff8dd45', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49932926-e56b-4c8f-84af-d286586f9e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49932926-e56b-4c8f-84af-d286586f9e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3e8dae-0313-48cc-904a-0e2821afaa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:18 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Volume f5f8231c-467d-4a8b-a90e-a32fbff8dd45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5f8231c-467d-4a8b-a90e-a32fbff8dd45', 'volume_size': 1} Jun 15 07:15:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:15:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:15:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-573810323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f8231c-467d-4a8b-a90e-a32fbff8dd45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7716d166f8e24daf85cd3a0cb4d6fb03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:15:18Z,use_quota=True,user_id='121d77768e1e415d978044f5681473e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:15:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Creating volume f5f8231c-467d-4a8b-a90e-a32fbff8dd45 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:15:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:15:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:15:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:15:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:15:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:15:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:15:18 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:15:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5f8231c-467d-4a8b-a90e-a32fbff8dd45 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:15:18 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5f8231c-467d-4a8b-a90e-a32fbff8dd45 1073741824 Jun 15 07:15:18 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:15:19 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Jun 15 07:15:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5f8231c-467d-4a8b-a90e-a32fbff8dd45 1073741824" returned: 0 in 1.376s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:15:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5f8231c-467d-4a8b-a90e-a32fbff8dd45 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:15:19 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5f8231c-467d-4a8b-a90e-a32fbff8dd45 Jun 15 07:15:19 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:15:21 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Jun 15 07:15:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5f8231c-467d-4a8b-a90e-a32fbff8dd45" returned: 0 in 1.653s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:15:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] <== create_volume: return (3155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:15:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.165s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:15:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3e8dae-0313-48cc-904a-0e2821afaa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5f8231c-467d-4a8b-a90e-a32fbff8dd45', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb61aaf1-c858-41ac-a4ff-5058de1a667b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:21 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Volume volume-f5f8231c-467d-4a8b-a90e-a32fbff8dd45 (f5f8231c-467d-4a8b-a90e-a32fbff8dd45): created successfully Jun 15 07:15:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb61aaf1-c858-41ac-a4ff-5058de1a667b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Flow 'volume_create_manager' (53595cfb-64b4-4e33-b02a-be4b08b0fc11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:15:21 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-e04d783e-66db-417c-8d2e-742c2b448775 tempest-VolumesAdminNegativeTest-120122103 None] Created volume successfully. Jun 15 07:15:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Acquiring lock "cinder-f5f8231c-467d-4a8b-a90e-a32fbff8dd45-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:15:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Lock "cinder-f5f8231c-467d-4a8b-a90e-a32fbff8dd45-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:15:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Acquiring lock "cinder-quobyte-f5f8231c-467d-4a8b-a90e-a32fbff8dd45" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:15:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Lock "cinder-quobyte-f5f8231c-467d-4a8b-a90e-a32fbff8dd45" acquired by "delete_volume" :: waited 0.023s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:15:23 devstack cinder-volume[92129]: INFO oslo.privsep.daemon [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5una9dna/privsep.sock'] Jun 15 07:15:23 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5una9dna/privsep.sock Jun 15 07:15:23 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:15:26 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Jun 15 07:15:26 devstack cinder-volume[92129]: INFO oslo.privsep.daemon [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Spawned new privsep daemon via rootwrap Jun 15 07:15:26 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Accepted privsep connection to /tmp/tmp5una9dna/privsep.sock {{(pid=92129) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Jun 15 07:15:26 devstack cinder-volume[92129]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 15 07:15:26 devstack cinder-volume[92129]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 15 07:15:26 devstack cinder-volume[92129]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 15 07:15:26 devstack cinder-volume[92129]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 93211 Jun 15 07:15:26 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5314e4ab-236e-4bcb-ac81-c543aae30ce7]: (2,) {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:15:26 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2529e2b-4e64-45fa-9208-faf1f5a1c074]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:15:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5f8231c-467d-4a8b-a90e-a32fbff8dd45 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:15:26 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5f8231c-467d-4a8b-a90e-a32fbff8dd45 Jun 15 07:15:26 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:15:27 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Jun 15 07:15:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5f8231c-467d-4a8b-a90e-a32fbff8dd45" returned: 0 in 1.234s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:15:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5f8231c-467d-4a8b-a90e-a32fbff8dd45 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:15:27 devstack sudo[93218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5f8231c-467d-4a8b-a90e-a32fbff8dd45 Jun 15 07:15:27 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:15:28 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root Jun 15 07:15:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5f8231c-467d-4a8b-a90e-a32fbff8dd45" returned: 0 in 1.098s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:15:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Lock "cinder-quobyte-f5f8231c-467d-4a8b-a90e-a32fbff8dd45" released by "delete_volume" :: held 5.193s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:15:29 devstack cinder-volume[92129]: WARNING cinder.quota [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:15:29 devstack cinder-volume[92129]: WARNING cinder.quota [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:15:29 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Created reservations ['667922fd-c8d4-4e06-937e-85bb922beda3', 'dfdf57ed-4632-44f0-bbc6-9364f9fc8187', '2ebe08cc-f411-4bf2-9cf0-81c4ab01a80c', '233d4215-1779-4307-84b5-afc303827bd0'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:15:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:15:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:15:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:15:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:15:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:15:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:15:29 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:15:29 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:15:31 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Jun 15 07:15:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.568s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:15:31 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:15:31 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Deleted volume successfully. Jun 15 07:15:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-dca70940-6f76-4bdd-882c-a7cd64774c9d tempest-VolumesAdminNegativeTest-120122103 None] Lock "cinder-f5f8231c-467d-4a8b-a90e-a32fbff8dd45-delete_volume" released by "delete_volume" :: held 7.552s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Flow 'volume_create_manager' (94664e07-48c9-4049-9ed3-8b306b29d93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208981e5-9e4d-463f-a19e-e9873b7ad416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208981e5-9e4d-463f-a19e-e9873b7ad416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-665627591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e3dbc1-6398-4768-977e-5919b083bc43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ffe2c063374bda81d1b14e425e0718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:15:35Z,use_quota=True,user_id='af70df691f7d4f9c8015c027bb79f999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908b57af-39b5-4178-acc3-a5924df0f6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908b57af-39b5-4178-acc3-a5924df0f6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b0fa55-0e32-45a4-93c9-f4bc64b017f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b0fa55-0e32-45a4-93c9-f4bc64b017f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e3dbc1-6398-4768-977e-5919b083bc43', 'volume_name': 'volume-91e3dbc1-6398-4768-977e-5919b083bc43', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad49a56d-d06c-4493-a6f0-5dd42f4863b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad49a56d-d06c-4493-a6f0-5dd42f4863b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b9ddf4-5857-4d33-9285-5e43bfdb363c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:35 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Volume 91e3dbc1-6398-4768-977e-5919b083bc43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e3dbc1-6398-4768-977e-5919b083bc43', 'volume_size': 1} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-665627591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e3dbc1-6398-4768-977e-5919b083bc43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ffe2c063374bda81d1b14e425e0718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:15:35Z,use_quota=True,user_id='af70df691f7d4f9c8015c027bb79f999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Creating volume 91e3dbc1-6398-4768-977e-5919b083bc43 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:15:35 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:15:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-91e3dbc1-6398-4768-977e-5919b083bc43 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:15:35 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-91e3dbc1-6398-4768-977e-5919b083bc43 1073741824 Jun 15 07:15:35 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:15:36 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Jun 15 07:15:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-91e3dbc1-6398-4768-977e-5919b083bc43 1073741824" returned: 0 in 1.200s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:15:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-91e3dbc1-6398-4768-977e-5919b083bc43 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:15:36 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-91e3dbc1-6398-4768-977e-5919b083bc43 Jun 15 07:15:36 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:15:37 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Jun 15 07:15:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-91e3dbc1-6398-4768-977e-5919b083bc43" returned: 0 in 0.749s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:15:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:15:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:15:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b9ddf4-5857-4d33-9285-5e43bfdb363c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e3dbc1-6398-4768-977e-5919b083bc43', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf8ce89-24d3-40ed-850a-c451bd0857d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:37 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Volume volume-91e3dbc1-6398-4768-977e-5919b083bc43 (91e3dbc1-6398-4768-977e-5919b083bc43): created successfully Jun 15 07:15:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf8ce89-24d3-40ed-850a-c451bd0857d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Flow 'volume_create_manager' (94664e07-48c9-4049-9ed3-8b306b29d93f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:15:37 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-4f45d029-a8ce-4b02-b7c6-6d4abceb1b7b tempest-AttachVolumeNegativeTest-2132421219 None] Created volume successfully. Jun 15 07:15:43 devstack cinder-volume[92129]: WARNING py.warnings [req-60c746d9-21da-4de9-ba24-61bdfa2f1d41 req-0a8fb98a-8884-4b7d-bd78-db0bd31a9e7b tempest-AttachVolumeNegativeTest-2132421219 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2505: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jun 15 07:15:43 devstack cinder-volume[92129]: .first() Jun 15 07:15:43 devstack cinder-volume[92129]: Jun 15 07:15:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-60c746d9-21da-4de9-ba24-61bdfa2f1d41 req-0a8fb98a-8884-4b7d-bd78-db0bd31a9e7b tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:15:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-60c746d9-21da-4de9-ba24-61bdfa2f1d41 req-0a8fb98a-8884-4b7d-bd78-db0bd31a9e7b tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:15:43 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc93ed5-2438-466c-b459-72e963192079]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:15:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-60c746d9-21da-4de9-ba24-61bdfa2f1d41 req-0a8fb98a-8884-4b7d-bd78-db0bd31a9e7b tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-91e3dbc1-6398-4768-977e-5919b083bc43 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:15:44 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-91e3dbc1-6398-4768-977e-5919b083bc43 Jun 15 07:15:44 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:15:45 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Jun 15 07:15:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-60c746d9-21da-4de9-ba24-61bdfa2f1d41 req-0a8fb98a-8884-4b7d-bd78-db0bd31a9e7b tempest-AttachVolumeNegativeTest-2132421219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-91e3dbc1-6398-4768-977e-5919b083bc43" returned: 0 in 1.079s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:15:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-60c746d9-21da-4de9-ba24-61bdfa2f1d41 req-0a8fb98a-8884-4b7d-bd78-db0bd31a9e7b tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.101s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:15:45 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-60c746d9-21da-4de9-ba24-61bdfa2f1d41 req-0a8fb98a-8884-4b7d-bd78-db0bd31a9e7b tempest-AttachVolumeNegativeTest-2132421219 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-91e3dbc1-6398-4768-977e-5919b083bc43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d2ba76c-77a0-4451-bef0-36ac9412639a', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:15:45 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-60c746d9-21da-4de9-ba24-61bdfa2f1d41 req-0a8fb98a-8884-4b7d-bd78-db0bd31a9e7b tempest-AttachVolumeNegativeTest-2132421219 None] attachment_update completed successfully. Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Flow 'volume_create_manager' (554e1368-b81c-4c1f-9a62-07c264cf372e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a11193-dbcc-4e00-b487-d6f82d2eb9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a11193-dbcc-4e00-b487-d6f82d2eb9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-452030693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d1b554f-49d7-4e30-9f2c-899575193758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93f9a506c77418c82f9465fb867c2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:15:56Z,use_quota=True,user_id='f0f0934ab443402db11492515d81b7e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f86bdcf-20de-4778-8c59-050108835ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f86bdcf-20de-4778-8c59-050108835ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272cf3df-eac1-48be-bda6-7befc8cf9276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272cf3df-eac1-48be-bda6-7befc8cf9276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d1b554f-49d7-4e30-9f2c-899575193758', 'volume_name': 'volume-2d1b554f-49d7-4e30-9f2c-899575193758', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293bc1e5-0868-412d-aaf6-f9b31bc2a313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293bc1e5-0868-412d-aaf6-f9b31bc2a313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efb14fc-970e-4b94-9644-f349f2745726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:55 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Volume 2d1b554f-49d7-4e30-9f2c-899575193758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d1b554f-49d7-4e30-9f2c-899575193758', 'volume_size': 1} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-452030693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d1b554f-49d7-4e30-9f2c-899575193758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93f9a506c77418c82f9465fb867c2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:15:56Z,use_quota=True,user_id='f0f0934ab443402db11492515d81b7e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Creating volume 2d1b554f-49d7-4e30-9f2c-899575193758 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:15:55 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:15:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2d1b554f-49d7-4e30-9f2c-899575193758 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:15:55 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2d1b554f-49d7-4e30-9f2c-899575193758 1073741824 Jun 15 07:15:55 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:15:56 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Jun 15 07:15:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2d1b554f-49d7-4e30-9f2c-899575193758 1073741824" returned: 0 in 1.052s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:15:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2d1b554f-49d7-4e30-9f2c-899575193758 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:15:56 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2d1b554f-49d7-4e30-9f2c-899575193758 Jun 15 07:15:56 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:15:58 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Jun 15 07:15:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2d1b554f-49d7-4e30-9f2c-899575193758" returned: 0 in 1.260s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:15:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] <== create_volume: return (2375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:15:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.379s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:15:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efb14fc-970e-4b94-9644-f349f2745726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d1b554f-49d7-4e30-9f2c-899575193758', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fece89c6-6acd-4f37-a92d-5414107e2bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:15:58 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Volume volume-2d1b554f-49d7-4e30-9f2c-899575193758 (2d1b554f-49d7-4e30-9f2c-899575193758): created successfully Jun 15 07:15:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fece89c6-6acd-4f37-a92d-5414107e2bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:15:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Flow 'volume_create_manager' (554e1368-b81c-4c1f-9a62-07c264cf372e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:15:58 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-5320432a-a8d6-4a6c-8bcd-7b38170bc344 tempest-DeleteServersTestJSON-1599309999 None] Created volume successfully. Jun 15 07:16:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-1abc44b5-f82f-49bd-ab3a-954279e6f3a6 req-de5c65e4-5bdc-4b32-a264-76dc3dea2cea tempest-DeleteServersTestJSON-1599309999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:16:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-1abc44b5-f82f-49bd-ab3a-954279e6f3a6 req-de5c65e4-5bdc-4b32-a264-76dc3dea2cea tempest-DeleteServersTestJSON-1599309999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:16:02 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bcee4d-fad3-4245-9412-1e520ed06a85]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:16:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-1abc44b5-f82f-49bd-ab3a-954279e6f3a6 req-de5c65e4-5bdc-4b32-a264-76dc3dea2cea tempest-DeleteServersTestJSON-1599309999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2d1b554f-49d7-4e30-9f2c-899575193758 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:16:02 devstack sudo[93923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2d1b554f-49d7-4e30-9f2c-899575193758 Jun 15 07:16:02 devstack sudo[93923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:16:03 devstack sudo[93923]: pam_unix(sudo:session): session closed for user root Jun 15 07:16:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-1abc44b5-f82f-49bd-ab3a-954279e6f3a6 req-de5c65e4-5bdc-4b32-a264-76dc3dea2cea tempest-DeleteServersTestJSON-1599309999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2d1b554f-49d7-4e30-9f2c-899575193758" returned: 0 in 1.025s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:16:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-1abc44b5-f82f-49bd-ab3a-954279e6f3a6 req-de5c65e4-5bdc-4b32-a264-76dc3dea2cea tempest-DeleteServersTestJSON-1599309999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.065s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:16:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-1abc44b5-f82f-49bd-ab3a-954279e6f3a6 req-de5c65e4-5bdc-4b32-a264-76dc3dea2cea tempest-DeleteServersTestJSON-1599309999 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-2d1b554f-49d7-4e30-9f2c-899575193758', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05c1402f-c2db-4182-9a7d-14eecfc8ff5b', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:16:03 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-1abc44b5-f82f-49bd-ab3a-954279e6f3a6 req-de5c65e4-5bdc-4b32-a264-76dc3dea2cea tempest-DeleteServersTestJSON-1599309999 None] attachment_update completed successfully. Jun 15 07:16:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-01f9065e-dd67-460f-879c-6c90ebb61d57 req-a9991a0d-c635-419a-b45f-ab7e31214478 tempest-TaggedAttachmentsTest-899565810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:16:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-01f9065e-dd67-460f-879c-6c90ebb61d57 req-a9991a0d-c635-419a-b45f-ab7e31214478 tempest-TaggedAttachmentsTest-899565810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:16:05 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6685a9-4139-4fce-93ae-7b3b63a15be7]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:16:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-01f9065e-dd67-460f-879c-6c90ebb61d57 req-a9991a0d-c635-419a-b45f-ab7e31214478 tempest-TaggedAttachmentsTest-899565810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:16:05 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede Jun 15 07:16:05 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:16:06 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Jun 15 07:16:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-01f9065e-dd67-460f-879c-6c90ebb61d57 req-a9991a0d-c635-419a-b45f-ab7e31214478 tempest-TaggedAttachmentsTest-899565810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede" returned: 0 in 0.890s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:16:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-01f9065e-dd67-460f-879c-6c90ebb61d57 req-a9991a0d-c635-419a-b45f-ab7e31214478 tempest-TaggedAttachmentsTest-899565810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.918s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:16:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-01f9065e-dd67-460f-879c-6c90ebb61d57 req-a9991a0d-c635-419a-b45f-ab7e31214478 tempest-TaggedAttachmentsTest-899565810 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7c05ec0-8809-40a1-8fbb-652e2ecdce7c', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:16:06 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-01f9065e-dd67-460f-879c-6c90ebb61d57 req-a9991a0d-c635-419a-b45f-ab7e31214478 tempest-TaggedAttachmentsTest-899565810 None] attachment_update completed successfully. Jun 15 07:16:13 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:UPDATE=20,cinder:SELECT=28,cinder:INSERT=4,cinder:DELETE=2 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:16:13 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=30,cinder:UPDATE=24,cinder:DELETE=2,cinder:INSERT=3 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:16:13 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-bcb90df1-4fc2-453e-9a7a-1ff2d693a418 req-c4ee0d51-04cb-4089-aea5-62955753754a tempest-DeleteServersTestJSON-1599309999 None] Terminate volume connection completed successfully. Jun 15 07:16:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-bcb90df1-4fc2-453e-9a7a-1ff2d693a418 req-c4ee0d51-04cb-4089-aea5-62955753754a tempest-DeleteServersTestJSON-1599309999 None] Deleting attachment 05c1402f-c2db-4182-9a7d-14eecfc8ff5b. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:16:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:16:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:16:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:16:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:16:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:16:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:16:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:16:13 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:16:13 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:16:14 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-8a910d2d-7bef-4732-9d8b-cfe15516f0c9 req-fc774ee8-3265-4613-a1e3-9928e6acce9a tempest-TaggedAttachmentsTest-899565810 None] Terminate volume connection completed successfully. Jun 15 07:16:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-8a910d2d-7bef-4732-9d8b-cfe15516f0c9 req-fc774ee8-3265-4613-a1e3-9928e6acce9a tempest-TaggedAttachmentsTest-899565810 None] Deleting attachment f7c05ec0-8809-40a1-8fbb-652e2ecdce7c. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:16:14 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Jun 15 07:16:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.821s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:16:14 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:16:14 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:16:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 8 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:16:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:16:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] Acquiring lock "cinder-2d1b554f-49d7-4e30-9f2c-899575193758-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:16:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] Lock "cinder-2d1b554f-49d7-4e30-9f2c-899575193758-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:16:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] Acquiring lock "cinder-quobyte-2d1b554f-49d7-4e30-9f2c-899575193758" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:16:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] Lock "cinder-quobyte-2d1b554f-49d7-4e30-9f2c-899575193758" acquired by "delete_volume" :: waited 0.052s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:16:17 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[041c0fbc-4f5b-4ceb-9ae9-d6f6fe653949]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:16:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2d1b554f-49d7-4e30-9f2c-899575193758 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:16:17 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2d1b554f-49d7-4e30-9f2c-899575193758 Jun 15 07:16:17 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:16:18 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Jun 15 07:16:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2d1b554f-49d7-4e30-9f2c-899575193758" returned: 0 in 1.174s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:16:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2d1b554f-49d7-4e30-9f2c-899575193758 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:16:18 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2d1b554f-49d7-4e30-9f2c-899575193758 Jun 15 07:16:18 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:16:19 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Jun 15 07:16:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2d1b554f-49d7-4e30-9f2c-899575193758" returned: 0 in 1.163s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:16:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] Lock "cinder-quobyte-2d1b554f-49d7-4e30-9f2c-899575193758" released by "delete_volume" :: held 2.418s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:16:20 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] Created reservations ['5c6a8fcf-0aa3-4996-b43f-9957869447ef', 'd6306539-b968-480f-ad91-863001f25898', 'e44cc2ef-6473-42e4-bb77-af5df9f203a6', 'd7097cda-5566-41f1-b835-b7b5dbf005b8'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:16:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:16:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:16:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:16:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:16:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:16:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:16:20 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:16:20 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:16:21 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Jun 15 07:16:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.886s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:16:21 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:16:21 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] Deleted volume successfully. Jun 15 07:16:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-93b65fe8-b4b1-423e-ba7f-39b66001f162 tempest-DeleteServersTestJSON-1599309999 None] Lock "cinder-2d1b554f-49d7-4e30-9f2c-899575193758-delete_volume" released by "delete_volume" :: held 3.652s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:16:30 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:16:31 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:16:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] Acquiring lock "cinder-54d1e5a1-df95-46e3-9c71-b5ce59a44ede-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:16:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] Lock "cinder-54d1e5a1-df95-46e3-9c71-b5ce59a44ede-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:16:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] Acquiring lock "cinder-quobyte-54d1e5a1-df95-46e3-9c71-b5ce59a44ede" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:16:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] Lock "cinder-quobyte-54d1e5a1-df95-46e3-9c71-b5ce59a44ede" acquired by "delete_volume" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:16:37 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[274886d0-172a-40f4-82ea-5b17edeb0470]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:16:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:16:37 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede Jun 15 07:16:37 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:16:37 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Jun 15 07:16:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede" returned: 0 in 0.917s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:16:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:16:38 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede Jun 15 07:16:38 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:16:38 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Jun 15 07:16:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54d1e5a1-df95-46e3-9c71-b5ce59a44ede" returned: 0 in 0.902s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:16:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] Lock "cinder-quobyte-54d1e5a1-df95-46e3-9c71-b5ce59a44ede" released by "delete_volume" :: held 1.901s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:16:39 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] Created reservations ['69c56e2e-9c9f-4d6b-9d50-4d17ad8fbc66', 'ab733707-f099-400f-885a-20e489ad3411', 'cc0d15bf-2531-4518-b895-7a5bffadb734', 'ff6c3023-9ede-4344-8c48-6c473cd6a305'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:16:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:16:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:16:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:16:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:16:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:16:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:16:39 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:16:39 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:16:40 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Jun 15 07:16:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.097s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:16:40 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:16:40 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] Deleted volume successfully. Jun 15 07:16:40 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-815c9b69-2d42-405e-a976-6184888f30c1 tempest-TaggedAttachmentsTest-899565810 None] Lock "cinder-54d1e5a1-df95-46e3-9c71-b5ce59a44ede-delete_volume" released by "delete_volume" :: held 3.354s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:16:49 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:16:50 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:16:51 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-db81a175-2cbb-410e-b78a-ab38ec841e58 req-a6627295-f146-4c67-94aa-6fd3151fcca1 tempest-AttachVolumeNegativeTest-2132421219 None] Terminate volume connection completed successfully. Jun 15 07:16:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-db81a175-2cbb-410e-b78a-ab38ec841e58 req-a6627295-f146-4c67-94aa-6fd3151fcca1 tempest-AttachVolumeNegativeTest-2132421219 None] Deleting attachment 7d2ba76c-77a0-4451-bef0-36ac9412639a. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Flow 'volume_create_manager' (332788cd-c29c-4b03-bb96-19662f243249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e60db32-1139-4f21-97b2-3b5705be1a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e60db32-1139-4f21-97b2-3b5705be1a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-956170231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4148498e7d2f4b1888b701ca7c23f24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:16:55Z,use_quota=True,user_id='69b23c9df828400d8fa61b7555174f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857195d0-6d73-4261-9dac-1ca41a1ec875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857195d0-6d73-4261-9dac-1ca41a1ec875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78d0a05-3e66-485a-baf7-f37eaa33078b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78d0a05-3e66-485a-baf7-f37eaa33078b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e', 'volume_name': 'volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd7c9c9-d029-41ac-8677-f65723fc6f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd7c9c9-d029-41ac-8677-f65723fc6f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569e150b-b37e-48b2-9aab-d307006a8f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:16:55 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Volume f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e', 'volume_size': 1} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-956170231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4148498e7d2f4b1888b701ca7c23f24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:16:55Z,use_quota=True,user_id='69b23c9df828400d8fa61b7555174f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Creating volume f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:16:55 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:16:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:16:55 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e 1073741824 Jun 15 07:16:55 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:16:56 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Jun 15 07:16:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e 1073741824" returned: 0 in 0.988s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:16:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:16:56 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e Jun 15 07:16:56 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:16:57 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Jun 15 07:16:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e" returned: 0 in 0.835s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:16:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:16:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:16:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569e150b-b37e-48b2-9aab-d307006a8f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:16:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1efc989-fab1-42fa-9539-ad3a003fd43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:16:57 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Volume volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e (f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e): created successfully Jun 15 07:16:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1efc989-fab1-42fa-9539-ad3a003fd43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:16:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Flow 'volume_create_manager' (332788cd-c29c-4b03-bb96-19662f243249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:16:57 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-b94204f1-a534-4078-a7a2-408016f2333d tempest-AttachVolumeShelveTestJSON-831138000 None] Created volume successfully. Jun 15 07:17:07 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:17:07 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:17:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:17:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:17:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:17:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:17:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:17:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:17:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:13 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:17:13 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:15 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.438s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:15 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:17:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-acc1b124-4a85-4317-88ff-e0b02805c4d1 req-a250f50a-2e7d-47aa-81c1-5097a7bd1376 tempest-AttachVolumeShelveTestJSON-831138000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:17:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-acc1b124-4a85-4317-88ff-e0b02805c4d1 req-a250f50a-2e7d-47aa-81c1-5097a7bd1376 tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:17:23 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2516e7-e35e-4a03-8ddb-7c9a8cfe9d6b]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:17:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-acc1b124-4a85-4317-88ff-e0b02805c4d1 req-a250f50a-2e7d-47aa-81c1-5097a7bd1376 tempest-AttachVolumeShelveTestJSON-831138000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:23 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e Jun 15 07:17:23 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:25 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-acc1b124-4a85-4317-88ff-e0b02805c4d1 req-a250f50a-2e7d-47aa-81c1-5097a7bd1376 tempest-AttachVolumeShelveTestJSON-831138000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e" returned: 0 in 1.709s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-acc1b124-4a85-4317-88ff-e0b02805c4d1 req-a250f50a-2e7d-47aa-81c1-5097a7bd1376 tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.742s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:17:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-acc1b124-4a85-4317-88ff-e0b02805c4d1 req-a250f50a-2e7d-47aa-81c1-5097a7bd1376 tempest-AttachVolumeShelveTestJSON-831138000 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '416798bc-1967-486d-a121-6b072077aca4', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:17:25 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-acc1b124-4a85-4317-88ff-e0b02805c4d1 req-a250f50a-2e7d-47aa-81c1-5097a7bd1376 tempest-AttachVolumeShelveTestJSON-831138000 None] attachment_update completed successfully. Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Flow 'volume_create_manager' (3001c8d5-3444-4d03-b720-ebc23bf523a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae479a7d-5434-4c9d-bf9f-1fb0ef7a61e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae479a7d-5434-4c9d-bf9f-1fb0ef7a61e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-79020128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46e1c1a-a3a0-4a21-9d38-b190c5deaca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f3678a7a80e4782ae61cab7b9c46003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:17:26Z,use_quota=True,user_id='37b6c5b6a9984ab291ac165d5e9c4531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111782f1-8fd7-4df7-b26a-642b43e0f2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111782f1-8fd7-4df7-b26a-642b43e0f2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f48fb4d-3286-415d-9f04-175d6453db48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f48fb4d-3286-415d-9f04-175d6453db48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f46e1c1a-a3a0-4a21-9d38-b190c5deaca8', 'volume_name': 'volume-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393f67c2-aeda-446d-880b-81fa4be95c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393f67c2-aeda-446d-880b-81fa4be95c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f01fa4-fc23-4f80-a172-fbf8e9b378d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:17:26 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Volume f46e1c1a-a3a0-4a21-9d38-b190c5deaca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8', 'volume_size': 1} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-79020128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46e1c1a-a3a0-4a21-9d38-b190c5deaca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f3678a7a80e4782ae61cab7b9c46003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:17:26Z,use_quota=True,user_id='37b6c5b6a9984ab291ac165d5e9c4531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Creating volume f46e1c1a-a3a0-4a21-9d38-b190c5deaca8 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:17:26 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:17:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:26 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8 1073741824 Jun 15 07:17:26 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:27 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8 1073741824" returned: 0 in 0.957s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:27 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8 Jun 15 07:17:27 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:28 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8" returned: 0 in 1.237s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] <== create_volume: return (2245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:17:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.248s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:17:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f01fa4-fc23-4f80-a172-fbf8e9b378d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:17:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1b17ba-ee56-4979-bc22-ff9f5d5dbfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:17:28 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Volume volume-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8 (f46e1c1a-a3a0-4a21-9d38-b190c5deaca8): created successfully Jun 15 07:17:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1b17ba-ee56-4979-bc22-ff9f5d5dbfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:17:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Flow 'volume_create_manager' (3001c8d5-3444-4d03-b720-ebc23bf523a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:17:29 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-d816d34e-a0ea-40d8-81ab-4c5ae1c1f8f5 tempest-ServerRescueNegativeTestJSON-130523119 None] Created volume successfully. Jun 15 07:17:38 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:17:39 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:17:56 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] Acquiring lock "cinder-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:17:56 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] Lock "cinder-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:17:56 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] Acquiring lock "cinder-quobyte-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:17:56 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] Lock "cinder-quobyte-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8" acquired by "delete_volume" :: waited 0.030s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:17:56 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a63756-4b18-4e3d-b9a5-9ae9ccf19629]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:17:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:56 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8 Jun 15 07:17:56 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:57 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8" returned: 0 in 0.786s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:57 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8 Jun 15 07:17:57 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:57 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8" returned: 0 in 0.725s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:57 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] Lock "cinder-quobyte-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8" released by "delete_volume" :: held 1.573s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:17:58 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] Created reservations ['a50f309f-d141-4b68-9c62-0792d6381fc4', 'd3a5df03-9d6c-45e0-84ed-f3f9873b4b5a', '16d4cce6-1561-4696-aa28-35711b61411f', '436ae44e-9e3f-4748-97ef-540f143f44f0'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:17:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:17:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:17:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:17:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:17:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:17:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:58 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:17:58 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:59 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.044s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:17:59 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] Deleted volume successfully. Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0f1bcb14-2309-4b73-b02b-c762a5c21a50 tempest-ServerRescueNegativeTestJSON-130523119 None] Lock "cinder-f46e1c1a-a3a0-4a21-9d38-b190c5deaca8-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Flow 'volume_create_manager' (34779575-b352-4e22-b21a-09837f4bcbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b823b8d1-67a2-4c1b-b753-f8df64e62911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b823b8d1-67a2-4c1b-b753-f8df64e62911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1045740546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f3dd3c-632a-4e16-bfcd-356fb6209674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26fe156a6384ca8933a83784ad42de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:17:59Z,use_quota=True,user_id='d231c654e33a4e19b80ba111f70e09b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a79eadc-9b5d-4793-9a3d-b711fd3178fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a79eadc-9b5d-4793-9a3d-b711fd3178fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d1ac3a-8067-4834-a412-2c97b0bf629d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d1ac3a-8067-4834-a412-2c97b0bf629d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f3dd3c-632a-4e16-bfcd-356fb6209674', 'volume_name': 'volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec1d16b8-97d9-406d-830d-775906d5b6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec1d16b8-97d9-406d-830d-775906d5b6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af980996-32a8-4e37-b527-bc9c7088945c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:17:59 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Volume c6f3dd3c-632a-4e16-bfcd-356fb6209674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674', 'volume_size': 1} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1045740546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f3dd3c-632a-4e16-bfcd-356fb6209674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26fe156a6384ca8933a83784ad42de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:17:59Z,use_quota=True,user_id='d231c654e33a4e19b80ba111f70e09b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Creating volume c6f3dd3c-632a-4e16-bfcd-356fb6209674 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:17:59 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:17:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:59 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674 1073741824 Jun 15 07:17:59 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:18:01 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Jun 15 07:18:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674 1073741824" returned: 0 in 1.933s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:18:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:18:01 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674 Jun 15 07:18:01 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:18:02 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Jun 15 07:18:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674" returned: 0 in 1.264s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:18:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] <== create_volume: return (3307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:18:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.310s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:18:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af980996-32a8-4e37-b527-bc9c7088945c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:18:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3e976b-1a9d-47e0-9e39-ce05c56b18be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:18:02 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Volume volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674 (c6f3dd3c-632a-4e16-bfcd-356fb6209674): created successfully Jun 15 07:18:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3e976b-1a9d-47e0-9e39-ce05c56b18be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:18:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Flow 'volume_create_manager' (34779575-b352-4e22-b21a-09837f4bcbca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:18:02 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-cc0963de-dd2e-4591-baad-2a6f7c8a0b46 tempest-ServerActionsTestOtherA-2108723054 None] Created volume successfully. Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Flow 'volume_create_manager' (9ad09d48-b120-497d-b3aa-9d6ecf2d5532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c380e6-773f-4710-8448-0abdb3083a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c380e6-773f-4710-8448-0abdb3083a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1390491486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ffe2c063374bda81d1b14e425e0718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:18:04Z,use_quota=True,user_id='af70df691f7d4f9c8015c027bb79f999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53529f0d-fa3d-49aa-bff1-f0192ccb95ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53529f0d-fa3d-49aa-bff1-f0192ccb95ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0a1ce9-b757-4f72-94af-f15000a3d273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0a1ce9-b757-4f72-94af-f15000a3d273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119', 'volume_name': 'volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10638383-0daf-4a30-8923-28b653ab0a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10638383-0daf-4a30-8923-28b653ab0a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a9aecf-2253-46c8-a832-43d9c2cbf0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:18:04 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Volume e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119', 'volume_size': 1} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1390491486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ffe2c063374bda81d1b14e425e0718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:18:04Z,use_quota=True,user_id='af70df691f7d4f9c8015c027bb79f999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Creating volume e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:18:04 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:18:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:18:04 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119 1073741824 Jun 15 07:18:04 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:18:05 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Jun 15 07:18:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119 1073741824" returned: 0 in 1.230s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:18:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:18:05 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119 Jun 15 07:18:05 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:18:06 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Jun 15 07:18:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119" returned: 0 in 0.827s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:18:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] <== create_volume: return (2124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:18:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:18:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a9aecf-2253-46c8-a832-43d9c2cbf0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:18:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e9dc50-249f-4848-abea-ec46be45b5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:18:06 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Volume volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119 (e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119): created successfully Jun 15 07:18:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e9dc50-249f-4848-abea-ec46be45b5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:18:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Flow 'volume_create_manager' (9ad09d48-b120-497d-b3aa-9d6ecf2d5532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:18:06 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-1bde0b59-8518-4880-95f5-f87515c2682b tempest-AttachVolumeNegativeTest-2132421219 None] Created volume successfully. Jun 15 07:18:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-32aaa07e-e244-4701-bac0-84e21920675e req-8e85bff1-d9b4-46fa-9f42-67047e2a6cd3 tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:18:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-32aaa07e-e244-4701-bac0-84e21920675e req-8e85bff1-d9b4-46fa-9f42-67047e2a6cd3 tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:18:11 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce4e91b-9afb-448a-ae1f-5d546077739c]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:18:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-32aaa07e-e244-4701-bac0-84e21920675e req-8e85bff1-d9b4-46fa-9f42-67047e2a6cd3 tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:18:11 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119 Jun 15 07:18:11 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:18:11 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Jun 15 07:18:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-32aaa07e-e244-4701-bac0-84e21920675e req-8e85bff1-d9b4-46fa-9f42-67047e2a6cd3 tempest-AttachVolumeNegativeTest-2132421219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119" returned: 0 in 0.787s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:18:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-32aaa07e-e244-4701-bac0-84e21920675e req-8e85bff1-d9b4-46fa-9f42-67047e2a6cd3 tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.809s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:18:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-32aaa07e-e244-4701-bac0-84e21920675e req-8e85bff1-d9b4-46fa-9f42-67047e2a6cd3 tempest-AttachVolumeNegativeTest-2132421219 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45d9fd93-dedb-4d7e-b551-2346a5537be0', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:18:11 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-32aaa07e-e244-4701-bac0-84e21920675e req-8e85bff1-d9b4-46fa-9f42-67047e2a6cd3 tempest-AttachVolumeNegativeTest-2132421219 None] attachment_update completed successfully. Jun 15 07:18:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:18:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:18:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:18:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:18:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:18:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:18:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:18:13 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:18:13 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:18:14 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Jun 15 07:18:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.665s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:18:14 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:18:14 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:18:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 8 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:18:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:18:20 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-a0f9e03c-0beb-45e0-b669-cf0ef5c6bdfd req-dd41f1b5-bec6-4b51-a144-a5360ec3ee44 tempest-AttachVolumeNegativeTest-2132421219 None] Terminate volume connection completed successfully. Jun 15 07:18:20 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-a0f9e03c-0beb-45e0-b669-cf0ef5c6bdfd req-dd41f1b5-bec6-4b51-a144-a5360ec3ee44 tempest-AttachVolumeNegativeTest-2132421219 None] Deleting attachment 45d9fd93-dedb-4d7e-b551-2346a5537be0. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:18:21 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=15,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=2 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:18:30 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-4f0effbb-f69a-4fd3-a496-89e3c15d82db req-e8f66a54-5611-47f6-8502-9bb7b38c5b9e tempest-AttachVolumeShelveTestJSON-831138000 None] Terminate volume connection completed successfully. Jun 15 07:18:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-4f0effbb-f69a-4fd3-a496-89e3c15d82db req-e8f66a54-5611-47f6-8502-9bb7b38c5b9e tempest-AttachVolumeShelveTestJSON-831138000 None] Deleting attachment 416798bc-1967-486d-a121-6b072077aca4. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:18:30 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=17,cinder:INSERT=1,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:18:40 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=2 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:18:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-59c36e10-d248-4295-9f2c-b1a40e40efd8 req-9d33796a-c6f1-43ee-a640-889d828b756c tempest-ServerActionsTestOtherA-2108723054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:18:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-59c36e10-d248-4295-9f2c-b1a40e40efd8 req-9d33796a-c6f1-43ee-a640-889d828b756c tempest-ServerActionsTestOtherA-2108723054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:18:44 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0055bf-cac7-4f81-b747-1a5aa16493ca]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:18:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-59c36e10-d248-4295-9f2c-b1a40e40efd8 req-9d33796a-c6f1-43ee-a640-889d828b756c tempest-ServerActionsTestOtherA-2108723054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:18:44 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674 Jun 15 07:18:44 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:18:45 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Jun 15 07:18:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-59c36e10-d248-4295-9f2c-b1a40e40efd8 req-9d33796a-c6f1-43ee-a640-889d828b756c tempest-ServerActionsTestOtherA-2108723054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674" returned: 0 in 0.949s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:18:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-59c36e10-d248-4295-9f2c-b1a40e40efd8 req-9d33796a-c6f1-43ee-a640-889d828b756c tempest-ServerActionsTestOtherA-2108723054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.982s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:18:45 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-59c36e10-d248-4295-9f2c-b1a40e40efd8 req-9d33796a-c6f1-43ee-a640-889d828b756c tempest-ServerActionsTestOtherA-2108723054 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c54aa42-5987-41b0-93a1-15045982c4ef', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:18:45 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-59c36e10-d248-4295-9f2c-b1a40e40efd8 req-9d33796a-c6f1-43ee-a640-889d828b756c tempest-ServerActionsTestOtherA-2108723054 None] attachment_update completed successfully. Jun 15 07:18:55 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:18:55 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:18:56 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-4ed2e59b-f0c3-4f80-8b08-4ebc7f743a40 req-f1c9b434-fc0d-4595-bde7-465589893ad9 tempest-ServerActionsTestOtherA-2108723054 None] Terminate volume connection completed successfully. Jun 15 07:18:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-4ed2e59b-f0c3-4f80-8b08-4ebc7f743a40 req-f1c9b434-fc0d-4595-bde7-465589893ad9 tempest-ServerActionsTestOtherA-2108723054 None] Deleting attachment 5c54aa42-5987-41b0-93a1-15045982c4ef. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:18:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-4ed2e59b-f0c3-4f80-8b08-4ebc7f743a40 req-e2cc65bb-a706-475d-8fb4-9b45fc506309 tempest-ServerActionsTestOtherA-2108723054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:18:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-4ed2e59b-f0c3-4f80-8b08-4ebc7f743a40 req-e2cc65bb-a706-475d-8fb4-9b45fc506309 tempest-ServerActionsTestOtherA-2108723054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:18:59 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf16eef-b333-482e-9060-d361717b5e6e]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:18:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-4ed2e59b-f0c3-4f80-8b08-4ebc7f743a40 req-e2cc65bb-a706-475d-8fb4-9b45fc506309 tempest-ServerActionsTestOtherA-2108723054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:18:59 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674 Jun 15 07:18:59 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:01 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-4ed2e59b-f0c3-4f80-8b08-4ebc7f743a40 req-e2cc65bb-a706-475d-8fb4-9b45fc506309 tempest-ServerActionsTestOtherA-2108723054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674" returned: 0 in 1.661s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-4ed2e59b-f0c3-4f80-8b08-4ebc7f743a40 req-e2cc65bb-a706-475d-8fb4-9b45fc506309 tempest-ServerActionsTestOtherA-2108723054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.705s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-4ed2e59b-f0c3-4f80-8b08-4ebc7f743a40 req-e2cc65bb-a706-475d-8fb4-9b45fc506309 tempest-ServerActionsTestOtherA-2108723054 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3bdf3352-730d-42c8-8a77-c7a22b86891b', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:19:01 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-4ed2e59b-f0c3-4f80-8b08-4ebc7f743a40 req-e2cc65bb-a706-475d-8fb4-9b45fc506309 tempest-ServerActionsTestOtherA-2108723054 None] attachment_update completed successfully. Jun 15 07:19:11 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:19:11 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:19:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:19:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:13 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:19:13 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:15 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.412s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:15 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:19:15 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:19:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 8 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:19:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Flow 'volume_create_manager' (b9c5f929-ac62-48e2-a4ba-176196fcaabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f4b164-e627-4e5c-915d-e6eedb1cb2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f4b164-e627-4e5c-915d-e6eedb1cb2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-112763261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af11a6d1-edf5-43ef-9d28-c886dc181bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ffe2c063374bda81d1b14e425e0718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:20Z,use_quota=True,user_id='af70df691f7d4f9c8015c027bb79f999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c935c4-add2-4354-b289-dd559b84242d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c935c4-add2-4354-b289-dd559b84242d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a002fb26-7164-42a4-9fde-672565339ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a002fb26-7164-42a4-9fde-672565339ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af11a6d1-edf5-43ef-9d28-c886dc181bdb', 'volume_name': 'volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61056ed-ff31-4a4d-8d5e-9c3160304c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61056ed-ff31-4a4d-8d5e-9c3160304c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70e37e4-5d0a-413a-b433-9b622fed224c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:19 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Volume af11a6d1-edf5-43ef-9d28-c886dc181bdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb', 'volume_size': 1} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-112763261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af11a6d1-edf5-43ef-9d28-c886dc181bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ffe2c063374bda81d1b14e425e0718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:20Z,use_quota=True,user_id='af70df691f7d4f9c8015c027bb79f999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Creating volume af11a6d1-edf5-43ef-9d28-c886dc181bdb {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:19:19 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:19:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:19 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb 1073741824 Jun 15 07:19:20 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:20 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb 1073741824" returned: 0 in 1.038s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:21 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb Jun 15 07:19:21 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:21 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb" returned: 0 in 0.725s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:19:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70e37e4-5d0a-413a-b433-9b622fed224c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b12371-7274-4e0b-a055-9f7b16c815dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:21 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Volume volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb (af11a6d1-edf5-43ef-9d28-c886dc181bdb): created successfully Jun 15 07:19:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b12371-7274-4e0b-a055-9f7b16c815dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Flow 'volume_create_manager' (b9c5f929-ac62-48e2-a4ba-176196fcaabd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:21 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-3346ab39-4ddc-4f3a-9e4a-a192dc6752e1 tempest-AttachVolumeNegativeTest-2132421219 None] Created volume successfully. Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Flow 'volume_create_manager' (ae8b173d-58d5-4b17-8bd3-9f62bd13a901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19357ad1-88c5-4da7-b119-38f9cc7d90a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19357ad1-88c5-4da7-b119-38f9cc7d90a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1152217838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e76bce-41fc-4795-b44d-03ce190d4bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63d3ae3980149c48386416f709ab140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:23Z,use_quota=True,user_id='0735e626f0ca482b9dca91fe835956a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b12d448-f9b4-4201-b7da-65805ebbec13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b12d448-f9b4-4201-b7da-65805ebbec13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a02c8ca-1242-4e39-b7da-5ca917b3bacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a02c8ca-1242-4e39-b7da-5ca917b3bacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6e76bce-41fc-4795-b44d-03ce190d4bd4', 'volume_name': 'volume-c6e76bce-41fc-4795-b44d-03ce190d4bd4', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2070d4-fa3c-4186-9c7b-1ef1b3e9f10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2070d4-fa3c-4186-9c7b-1ef1b3e9f10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa977a4-2694-4020-acce-a3ef40b4d1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:23 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Volume c6e76bce-41fc-4795-b44d-03ce190d4bd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6e76bce-41fc-4795-b44d-03ce190d4bd4', 'volume_size': 1} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1152217838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e76bce-41fc-4795-b44d-03ce190d4bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63d3ae3980149c48386416f709ab140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:23Z,use_quota=True,user_id='0735e626f0ca482b9dca91fe835956a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Creating volume c6e76bce-41fc-4795-b44d-03ce190d4bd4 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:19:23 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:19:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6e76bce-41fc-4795-b44d-03ce190d4bd4 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:23 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6e76bce-41fc-4795-b44d-03ce190d4bd4 1073741824 Jun 15 07:19:23 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:24 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6e76bce-41fc-4795-b44d-03ce190d4bd4 1073741824" returned: 0 in 0.882s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6e76bce-41fc-4795-b44d-03ce190d4bd4 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:24 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6e76bce-41fc-4795-b44d-03ce190d4bd4 Jun 15 07:19:24 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:24 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6e76bce-41fc-4795-b44d-03ce190d4bd4" returned: 0 in 0.846s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:19:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa977a4-2694-4020-acce-a3ef40b4d1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6e76bce-41fc-4795-b44d-03ce190d4bd4', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532969a3-36bc-458e-92a5-1abcfd016668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:24 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Volume volume-c6e76bce-41fc-4795-b44d-03ce190d4bd4 (c6e76bce-41fc-4795-b44d-03ce190d4bd4): created successfully Jun 15 07:19:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532969a3-36bc-458e-92a5-1abcfd016668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Flow 'volume_create_manager' (ae8b173d-58d5-4b17-8bd3-9f62bd13a901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:24 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-4d61f1da-f1eb-46bd-9213-c043f30c767f tempest-ServersNegativeTestJSON-2083946235 None] Created volume successfully. Jun 15 07:19:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-4c1392ca-5759-4a99-af41-a81926d08de3 req-99c7ce93-8435-4746-b081-414d667b0338 tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-4c1392ca-5759-4a99-af41-a81926d08de3 req-99c7ce93-8435-4746-b081-414d667b0338 tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:25 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c96d20-2233-4384-95b9-b737ff4c431c]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:19:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-4c1392ca-5759-4a99-af41-a81926d08de3 req-99c7ce93-8435-4746-b081-414d667b0338 tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:25 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb Jun 15 07:19:25 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:26 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-4c1392ca-5759-4a99-af41-a81926d08de3 req-99c7ce93-8435-4746-b081-414d667b0338 tempest-AttachVolumeNegativeTest-2132421219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb" returned: 0 in 0.810s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-4c1392ca-5759-4a99-af41-a81926d08de3 req-99c7ce93-8435-4746-b081-414d667b0338 tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.840s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-4c1392ca-5759-4a99-af41-a81926d08de3 req-99c7ce93-8435-4746-b081-414d667b0338 tempest-AttachVolumeNegativeTest-2132421219 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7e5bfc6-0ebd-4654-8b17-8126c3caa67a', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:19:26 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-4c1392ca-5759-4a99-af41-a81926d08de3 req-99c7ce93-8435-4746-b081-414d667b0338 tempest-AttachVolumeNegativeTest-2132421219 None] attachment_update completed successfully. Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Flow 'volume_create_manager' (9833b80a-00e7-4e33-b85a-65708ef8883e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3a7cb8-d9cb-4637-a0dc-6da4e7711735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3a7cb8-d9cb-4637-a0dc-6da4e7711735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2136231623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108ad0fa-60b8-43eb-815f-13afc67660cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63d3ae3980149c48386416f709ab140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:26Z,use_quota=True,user_id='0735e626f0ca482b9dca91fe835956a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf7e9e1-590b-4c03-95ed-f61d9ca177b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf7e9e1-590b-4c03-95ed-f61d9ca177b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96097329-4a0f-4852-bdf1-94c0b2e7c8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96097329-4a0f-4852-bdf1-94c0b2e7c8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '108ad0fa-60b8-43eb-815f-13afc67660cb', 'volume_name': 'volume-108ad0fa-60b8-43eb-815f-13afc67660cb', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7c66eb-bbdd-4adc-8be7-1fdf3803421b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7c66eb-bbdd-4adc-8be7-1fdf3803421b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c22b40-03fe-483f-ae3b-2481bc95f9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:26 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Volume 108ad0fa-60b8-43eb-815f-13afc67660cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-108ad0fa-60b8-43eb-815f-13afc67660cb', 'volume_size': 1} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2136231623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108ad0fa-60b8-43eb-815f-13afc67660cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63d3ae3980149c48386416f709ab140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:26Z,use_quota=True,user_id='0735e626f0ca482b9dca91fe835956a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Creating volume 108ad0fa-60b8-43eb-815f-13afc67660cb {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:19:26 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:19:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-108ad0fa-60b8-43eb-815f-13afc67660cb 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:26 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-108ad0fa-60b8-43eb-815f-13afc67660cb 1073741824 Jun 15 07:19:26 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:27 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-108ad0fa-60b8-43eb-815f-13afc67660cb 1073741824" returned: 0 in 0.878s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-108ad0fa-60b8-43eb-815f-13afc67660cb {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:27 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-108ad0fa-60b8-43eb-815f-13afc67660cb Jun 15 07:19:27 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:28 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-108ad0fa-60b8-43eb-815f-13afc67660cb" returned: 0 in 0.665s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:19:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c22b40-03fe-483f-ae3b-2481bc95f9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-108ad0fa-60b8-43eb-815f-13afc67660cb', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff1bf28-9e4f-41d0-b680-dc3b12668c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:28 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Volume volume-108ad0fa-60b8-43eb-815f-13afc67660cb (108ad0fa-60b8-43eb-815f-13afc67660cb): created successfully Jun 15 07:19:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff1bf28-9e4f-41d0-b680-dc3b12668c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Flow 'volume_create_manager' (9833b80a-00e7-4e33-b85a-65708ef8883e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:28 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-d5ee83ac-1f52-4705-9600-67cfbf6febff tempest-ServersNegativeTestJSON-2083946235 None] Created volume successfully. Jun 15 07:19:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] Acquiring lock "cinder-108ad0fa-60b8-43eb-815f-13afc67660cb-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:19:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] Lock "cinder-108ad0fa-60b8-43eb-815f-13afc67660cb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:19:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] Acquiring lock "cinder-quobyte-108ad0fa-60b8-43eb-815f-13afc67660cb" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:19:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] Lock "cinder-quobyte-108ad0fa-60b8-43eb-815f-13afc67660cb" acquired by "delete_volume" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:19:29 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dfc0c6-f24d-4692-903a-8b199f13cf74]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:19:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-108ad0fa-60b8-43eb-815f-13afc67660cb {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:29 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-108ad0fa-60b8-43eb-815f-13afc67660cb Jun 15 07:19:29 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:29 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-108ad0fa-60b8-43eb-815f-13afc67660cb" returned: 0 in 0.709s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-108ad0fa-60b8-43eb-815f-13afc67660cb {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:29 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-108ad0fa-60b8-43eb-815f-13afc67660cb Jun 15 07:19:29 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:30 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-108ad0fa-60b8-43eb-815f-13afc67660cb" returned: 0 in 0.613s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:30 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] Lock "cinder-quobyte-108ad0fa-60b8-43eb-815f-13afc67660cb" released by "delete_volume" :: held 1.363s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:19:30 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] Created reservations ['a8f42f1e-558d-4103-be8b-bca78f83f75b', '3af31781-1fe5-4f06-b8ca-0debf2efa40d', '2d9c62b3-dbd5-406f-9efb-3738b57252bb', '00321d96-ac8d-4037-b9ea-09496c71d198'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:19:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:30 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:19:30 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:31 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.612s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:31 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:19:31 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] Deleted volume successfully. Jun 15 07:19:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8dcc8c88-c55d-4e41-a540-1fcc96715579 tempest-ServersNegativeTestJSON-2083946235 None] Lock "cinder-108ad0fa-60b8-43eb-815f-13afc67660cb-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:19:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] Acquiring lock "cinder-c6e76bce-41fc-4795-b44d-03ce190d4bd4-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:19:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] Lock "cinder-c6e76bce-41fc-4795-b44d-03ce190d4bd4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:19:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] Acquiring lock "cinder-quobyte-c6e76bce-41fc-4795-b44d-03ce190d4bd4" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:19:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] Lock "cinder-quobyte-c6e76bce-41fc-4795-b44d-03ce190d4bd4" acquired by "delete_volume" :: waited 0.018s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:19:31 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd905f1-e53e-42c5-9daf-213efd176e63]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:19:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6e76bce-41fc-4795-b44d-03ce190d4bd4 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:31 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6e76bce-41fc-4795-b44d-03ce190d4bd4 Jun 15 07:19:31 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:32 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6e76bce-41fc-4795-b44d-03ce190d4bd4" returned: 0 in 0.809s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6e76bce-41fc-4795-b44d-03ce190d4bd4 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:32 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6e76bce-41fc-4795-b44d-03ce190d4bd4 Jun 15 07:19:32 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:32 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6e76bce-41fc-4795-b44d-03ce190d4bd4" returned: 0 in 0.672s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] Lock "cinder-quobyte-c6e76bce-41fc-4795-b44d-03ce190d4bd4" released by "delete_volume" :: held 1.540s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:19:32 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] Created reservations ['3d03ceae-8196-41df-862a-81be33f33cfd', '920f3d76-d641-4207-ab63-df64c29b0749', '6a636a68-19ef-4834-afa4-0f23de625393', 'fae1d912-fa5f-4c73-be91-01c3cb6417cc'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:19:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:32 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:19:32 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:33 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-a75ebcbd-6770-46f2-b780-b5f145c1ce82 req-21ebb0ce-7f8d-491a-bf8f-684244a36402 tempest-AttachVolumeNegativeTest-2132421219 None] Terminate volume connection completed successfully. Jun 15 07:19:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-a75ebcbd-6770-46f2-b780-b5f145c1ce82 req-21ebb0ce-7f8d-491a-bf8f-684244a36402 tempest-AttachVolumeNegativeTest-2132421219 None] Deleting attachment f7e5bfc6-0ebd-4654-8b17-8126c3caa67a. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:19:33 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.659s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:33 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:19:33 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] Deleted volume successfully. Jun 15 07:19:33 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a02fa4a8-babe-4f07-b73a-64d8be0d06fb tempest-ServersNegativeTestJSON-2083946235 None] Lock "cinder-c6e76bce-41fc-4795-b44d-03ce190d4bd4-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:19:33 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Flow 'volume_create_manager' (1c440c31-84ea-4884-b713-1e936ae0dabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a349027-c334-4cca-887b-efa27a13fc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a349027-c334-4cca-887b-efa27a13fc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1485756216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bc75fa-1794-4922-b119-a0893e1548bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4148498e7d2f4b1888b701ca7c23f24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:34Z,use_quota=True,user_id='69b23c9df828400d8fa61b7555174f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03bfcea-b708-423a-9b55-d9748db31664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03bfcea-b708-423a-9b55-d9748db31664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd03d0f-acd4-465e-acd0-2752881add4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd03d0f-acd4-465e-acd0-2752881add4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47bc75fa-1794-4922-b119-a0893e1548bd', 'volume_name': 'volume-47bc75fa-1794-4922-b119-a0893e1548bd', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda6d0e0-69fc-48ac-90fb-4dc8f34e520b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda6d0e0-69fc-48ac-90fb-4dc8f34e520b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e5528f-446a-4093-8810-271237cae81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:34 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Volume 47bc75fa-1794-4922-b119-a0893e1548bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47bc75fa-1794-4922-b119-a0893e1548bd', 'volume_size': 1} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1485756216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bc75fa-1794-4922-b119-a0893e1548bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4148498e7d2f4b1888b701ca7c23f24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:34Z,use_quota=True,user_id='69b23c9df828400d8fa61b7555174f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Creating volume 47bc75fa-1794-4922-b119-a0893e1548bd {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:19:34 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:19:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-47bc75fa-1794-4922-b119-a0893e1548bd 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:34 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-47bc75fa-1794-4922-b119-a0893e1548bd 1073741824 Jun 15 07:19:34 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:35 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-47bc75fa-1794-4922-b119-a0893e1548bd 1073741824" returned: 0 in 1.207s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-47bc75fa-1794-4922-b119-a0893e1548bd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:35 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-47bc75fa-1794-4922-b119-a0893e1548bd Jun 15 07:19:35 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:36 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-47bc75fa-1794-4922-b119-a0893e1548bd" returned: 0 in 0.853s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:19:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.115s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e5528f-446a-4093-8810-271237cae81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47bc75fa-1794-4922-b119-a0893e1548bd', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d232f7-c329-4e6a-83b3-25a49f702fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:36 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Volume volume-47bc75fa-1794-4922-b119-a0893e1548bd (47bc75fa-1794-4922-b119-a0893e1548bd): created successfully Jun 15 07:19:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d232f7-c329-4e6a-83b3-25a49f702fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Flow 'volume_create_manager' (1c440c31-84ea-4884-b713-1e936ae0dabc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:36 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-9750508c-586d-4b7a-a87e-2738d6d446c7 tempest-AttachVolumeShelveTestJSON-831138000 None] Created volume successfully. Jun 15 07:19:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "cinder-af11a6d1-edf5-43ef-9d28-c886dc181bdb-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:19:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] Lock "cinder-af11a6d1-edf5-43ef-9d28-c886dc181bdb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:19:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "cinder-quobyte-af11a6d1-edf5-43ef-9d28-c886dc181bdb" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:19:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] Lock "cinder-quobyte-af11a6d1-edf5-43ef-9d28-c886dc181bdb" acquired by "delete_volume" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:19:43 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20c3e11-d7a7-4c25-995c-d28bac7d4e46]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:19:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:43 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb Jun 15 07:19:43 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:44 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb" returned: 0 in 0.890s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:44 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb Jun 15 07:19:44 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:45 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-af11a6d1-edf5-43ef-9d28-c886dc181bdb" returned: 0 in 0.857s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] Lock "cinder-quobyte-af11a6d1-edf5-43ef-9d28-c886dc181bdb" released by "delete_volume" :: held 1.815s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:19:45 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] Created reservations ['beadcd33-8a12-4f6c-a4ee-3de609c63f7f', '678e2a27-7ab8-418b-8fd8-77bb0093b5d3', 'f257c53a-be34-407a-ae38-9f4219f02fc5', 'b5c27ebd-4df6-4cad-a2f6-e13a689f9116'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:19:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:45 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:19:45 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "cinder-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:19:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] Lock "cinder-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:19:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "cinder-quobyte-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:19:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] Lock "cinder-quobyte-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119" acquired by "delete_volume" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:19:46 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac25303d-d75d-475e-bab2-f42b1d972ffa]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:19:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:46 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119 Jun 15 07:19:46 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:46 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.322s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:46 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:19:46 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] Deleted volume successfully. Jun 15 07:19:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2b8d2a72-24e2-4e62-b838-53a9564c9cbe tempest-AttachVolumeNegativeTest-2132421219 None] Lock "cinder-af11a6d1-edf5-43ef-9d28-c886dc181bdb-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:19:47 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119" returned: 0 in 1.108s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:47 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119 Jun 15 07:19:47 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:47 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119" returned: 0 in 0.639s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] Lock "cinder-quobyte-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119" released by "delete_volume" :: held 1.814s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:19:48 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] Created reservations ['e867be16-21ae-4da9-99e3-781fd189ded2', '2448cc43-eecf-482d-9a75-59ab53908710', '11e046f1-c25d-417b-9a09-9ac0ce88eac8', 'a619f15d-a4d9-48f8-936c-28f300d223f9'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:19:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:48 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:19:48 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "cinder-91e3dbc1-6398-4768-977e-5919b083bc43-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:19:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] Lock "cinder-91e3dbc1-6398-4768-977e-5919b083bc43-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:19:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "cinder-quobyte-91e3dbc1-6398-4768-977e-5919b083bc43" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:19:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] Lock "cinder-quobyte-91e3dbc1-6398-4768-977e-5919b083bc43" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:19:48 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc45015-deb5-4390-8181-a60e47fe9670]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:19:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-91e3dbc1-6398-4768-977e-5919b083bc43 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:48 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-91e3dbc1-6398-4768-977e-5919b083bc43 Jun 15 07:19:48 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:48 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.863s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:48 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:19:48 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] Deleted volume successfully. Jun 15 07:19:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-90cd87c1-d8d5-4944-9d6d-f88728f6c36f tempest-AttachVolumeNegativeTest-2132421219 None] Lock "cinder-e8ff53bc-88eb-4fcc-8fc2-22c7a9e33119-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:19:49 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-91e3dbc1-6398-4768-977e-5919b083bc43" returned: 0 in 0.948s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-91e3dbc1-6398-4768-977e-5919b083bc43 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:49 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-91e3dbc1-6398-4768-977e-5919b083bc43 Jun 15 07:19:49 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Flow 'volume_create_manager' (2dd56a02-2a0d-4309-a86d-50357abf9254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f00e693-4cd2-4e26-bd9f-ef0810eea8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f00e693-4cd2-4e26-bd9f-ef0810eea8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-314499403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff4b59b7-a790-4e7d-a7ab-192fd338b5dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa8b0c18b8ee43b7aa159e1c1bc03fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:50Z,use_quota=True,user_id='11d5f0089e9c4af787e8bc37afa27eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847b7ae8-c63b-433f-8d69-503ba7564840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847b7ae8-c63b-433f-8d69-503ba7564840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee354a21-a24c-48ce-8ea0-965da376360b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee354a21-a24c-48ce-8ea0-965da376360b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff4b59b7-a790-4e7d-a7ab-192fd338b5dc', 'volume_name': 'volume-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280c7f9d-8b6d-4bad-9bef-2a4012eaa84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280c7f9d-8b6d-4bad-9bef-2a4012eaa84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dd127a-27e2-401e-ab7e-46ae732557fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:50 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Volume ff4b59b7-a790-4e7d-a7ab-192fd338b5dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc', 'volume_size': 1} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-314499403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff4b59b7-a790-4e7d-a7ab-192fd338b5dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa8b0c18b8ee43b7aa159e1c1bc03fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:50Z,use_quota=True,user_id='11d5f0089e9c4af787e8bc37afa27eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Creating volume ff4b59b7-a790-4e7d-a7ab-192fd338b5dc {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:19:50 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:50 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc 1073741824 Jun 15 07:19:50 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:50 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-91e3dbc1-6398-4768-977e-5919b083bc43" returned: 0 in 0.646s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] Lock "cinder-quobyte-91e3dbc1-6398-4768-977e-5919b083bc43" released by "delete_volume" :: held 1.656s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] Created reservations ['c2406665-a9a3-43e0-bac0-63208a6901eb', '56dc02cb-e02e-48db-a333-0d5f1c327809', 'f00d2c79-3f03-4a89-a4b2-b9ee717be611', '1e9019ae-9809-46a3-a341-602c6d64bec0'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:50 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:19:50 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:51 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-b6332028-722c-4a69-bb8d-60a7ea33bc00 req-ed220168-f709-4eea-b58c-9daeb36c1011 tempest-ServerActionsTestOtherA-2108723054 None] Terminate volume connection completed successfully. Jun 15 07:19:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-b6332028-722c-4a69-bb8d-60a7ea33bc00 req-ed220168-f709-4eea-b58c-9daeb36c1011 tempest-ServerActionsTestOtherA-2108723054 None] Deleting attachment 3bdf3352-730d-42c8-8a77-c7a22b86891b. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:19:51 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:51 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc 1073741824" returned: 0 in 1.204s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.863s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:51 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:19:51 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] Deleted volume successfully. Jun 15 07:19:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-31c5ec44-3420-40ea-8edc-dc0201a3d2ae tempest-AttachVolumeNegativeTest-2132421219 None] Lock "cinder-91e3dbc1-6398-4768-977e-5919b083bc43-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:19:51 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc Jun 15 07:19:51 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:52 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc" returned: 0 in 0.753s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:19:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dd127a-27e2-401e-ab7e-46ae732557fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c8e4c8-2672-47d8-8fef-3caa691b5e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:52 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Volume volume-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc (ff4b59b7-a790-4e7d-a7ab-192fd338b5dc): created successfully Jun 15 07:19:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c8e4c8-2672-47d8-8fef-3caa691b5e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Flow 'volume_create_manager' (2dd56a02-2a0d-4309-a86d-50357abf9254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:52 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-55b35b03-3c54-4935-8a33-15a197a6e14f tempest-VolumesTestJSON-1674985507 None] Created volume successfully. Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-d0a2208e-2ab7-4a90-818e-ff27c3c45a2b req-e7d96f0e-95d2-40df-8b1f-6a3e110e6022 tempest-AttachVolumeShelveTestJSON-831138000 None] No connector for attachment 9b70b893-7688-40cd-8fc6-6c8eec66d727; skipping storage backend terminate_connection call. {{(pid=92129) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-d0a2208e-2ab7-4a90-818e-ff27c3c45a2b req-e7d96f0e-95d2-40df-8b1f-6a3e110e6022 tempest-AttachVolumeShelveTestJSON-831138000 None] Deleting attachment 9b70b893-7688-40cd-8fc6-6c8eec66d727. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Flow 'volume_create_manager' (d456bce4-ac65-4c9e-acfe-637f3153750b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8caaf68-4889-4e3f-b6c2-7eedf0233527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8caaf68-4889-4e3f-b6c2-7eedf0233527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-805936726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408f8812-eb15-4dac-a5ed-9e3cc966665a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa8b0c18b8ee43b7aa159e1c1bc03fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:54Z,use_quota=True,user_id='11d5f0089e9c4af787e8bc37afa27eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4865160-904a-4a5f-97ee-57e25a20bf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4865160-904a-4a5f-97ee-57e25a20bf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e10937d-6706-4bb3-b6ca-75f22f5964ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e10937d-6706-4bb3-b6ca-75f22f5964ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408f8812-eb15-4dac-a5ed-9e3cc966665a', 'volume_name': 'volume-408f8812-eb15-4dac-a5ed-9e3cc966665a', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8701f3a1-18d5-4801-976d-08d738e7cd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8701f3a1-18d5-4801-976d-08d738e7cd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a08b70e-9c11-40ae-9594-574087d58e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:53 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Volume 408f8812-eb15-4dac-a5ed-9e3cc966665a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408f8812-eb15-4dac-a5ed-9e3cc966665a', 'volume_size': 1} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-805936726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408f8812-eb15-4dac-a5ed-9e3cc966665a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa8b0c18b8ee43b7aa159e1c1bc03fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:54Z,use_quota=True,user_id='11d5f0089e9c4af787e8bc37afa27eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Creating volume 408f8812-eb15-4dac-a5ed-9e3cc966665a {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:19:53 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:19:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-408f8812-eb15-4dac-a5ed-9e3cc966665a 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:53 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-408f8812-eb15-4dac-a5ed-9e3cc966665a 1073741824 Jun 15 07:19:54 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:55 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-408f8812-eb15-4dac-a5ed-9e3cc966665a 1073741824" returned: 0 in 1.371s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-408f8812-eb15-4dac-a5ed-9e3cc966665a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:55 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-408f8812-eb15-4dac-a5ed-9e3cc966665a Jun 15 07:19:55 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:56 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-408f8812-eb15-4dac-a5ed-9e3cc966665a" returned: 0 in 0.876s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:56 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] <== create_volume: return (2304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:19:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.307s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a08b70e-9c11-40ae-9594-574087d58e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408f8812-eb15-4dac-a5ed-9e3cc966665a', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e940faf7-b943-4676-9746-e79b9742aa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:56 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Volume volume-408f8812-eb15-4dac-a5ed-9e3cc966665a (408f8812-eb15-4dac-a5ed-9e3cc966665a): created successfully Jun 15 07:19:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e940faf7-b943-4676-9746-e79b9742aa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Flow 'volume_create_manager' (d456bce4-ac65-4c9e-acfe-637f3153750b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:56 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-86892c1f-cf0f-4181-a508-e0fca34d6c7b tempest-VolumesTestJSON-1674985507 None] Created volume successfully. Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Flow 'volume_create_manager' (36017e6d-92d4-45a6-b393-3b7575b1649c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47d60fd-0c0c-44fe-8fd5-74e9f114c168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47d60fd-0c0c-44fe-8fd5-74e9f114c168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1297452120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff77065-9ec2-4614-9028-dc5a74751c53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa8b0c18b8ee43b7aa159e1c1bc03fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:58Z,use_quota=True,user_id='11d5f0089e9c4af787e8bc37afa27eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6e4a8e-ad3f-4615-8f37-7196a3e7dcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6e4a8e-ad3f-4615-8f37-7196a3e7dcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fc4122-63d3-4fc7-8bd8-17cb3627280c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fc4122-63d3-4fc7-8bd8-17cb3627280c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff77065-9ec2-4614-9028-dc5a74751c53', 'volume_name': 'volume-9ff77065-9ec2-4614-9028-dc5a74751c53', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d43947-cd57-431f-bcab-a9aefd82a468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d43947-cd57-431f-bcab-a9aefd82a468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92563ca2-ee65-442c-84dc-23d328102e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:57 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Volume 9ff77065-9ec2-4614-9028-dc5a74751c53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff77065-9ec2-4614-9028-dc5a74751c53', 'volume_size': 1} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1297452120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff77065-9ec2-4614-9028-dc5a74751c53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa8b0c18b8ee43b7aa159e1c1bc03fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:58Z,use_quota=True,user_id='11d5f0089e9c4af787e8bc37afa27eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Creating volume 9ff77065-9ec2-4614-9028-dc5a74751c53 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:19:57 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:19:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9ff77065-9ec2-4614-9028-dc5a74751c53 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:57 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9ff77065-9ec2-4614-9028-dc5a74751c53 1073741824 Jun 15 07:19:57 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:58 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9ff77065-9ec2-4614-9028-dc5a74751c53 1073741824" returned: 0 in 0.939s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9ff77065-9ec2-4614-9028-dc5a74751c53 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:58 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9ff77065-9ec2-4614-9028-dc5a74751c53 Jun 15 07:19:58 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:59 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9ff77065-9ec2-4614-9028-dc5a74751c53" returned: 0 in 0.610s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92563ca2-ee65-442c-84dc-23d328102e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff77065-9ec2-4614-9028-dc5a74751c53', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67642c35-2786-4576-863e-3f03e8f3c204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:59 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Volume volume-9ff77065-9ec2-4614-9028-dc5a74751c53 (9ff77065-9ec2-4614-9028-dc5a74751c53): created successfully Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67642c35-2786-4576-863e-3f03e8f3c204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Flow 'volume_create_manager' (36017e6d-92d4-45a6-b393-3b7575b1649c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:59 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-28e60e85-3b98-4ae4-b1d5-7849f9a042bb tempest-VolumesTestJSON-1674985507 None] Created volume successfully. Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Flow 'volume_create_manager' (29af57a5-745d-4a51-a7cc-e84190afd746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf3faf4-1d51-4b29-9d6f-663546ae00d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf3faf4-1d51-4b29-9d6f-663546ae00d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1843539663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef362eb5-f8b9-4c61-948a-d19beba6e345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb0cc84aa5d46ccba7b306e1219375f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:00Z,use_quota=True,user_id='0c589bc5804a4a5ab246f78fd4592a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4730c758-97d5-45d0-8de4-836ec6bf9bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4730c758-97d5-45d0-8de4-836ec6bf9bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46435966-e170-479f-a1db-0f00137d70b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46435966-e170-479f-a1db-0f00137d70b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef362eb5-f8b9-4c61-948a-d19beba6e345', 'volume_name': 'volume-ef362eb5-f8b9-4c61-948a-d19beba6e345', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d35be8-b91e-471b-9fe1-f5d398f1f083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d35be8-b91e-471b-9fe1-f5d398f1f083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2529f349-25d6-4c04-b1fa-1f948311840e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:59 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Volume ef362eb5-f8b9-4c61-948a-d19beba6e345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef362eb5-f8b9-4c61-948a-d19beba6e345', 'volume_size': 1} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1843539663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef362eb5-f8b9-4c61-948a-d19beba6e345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb0cc84aa5d46ccba7b306e1219375f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:00Z,use_quota=True,user_id='0c589bc5804a4a5ab246f78fd4592a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Creating volume ef362eb5-f8b9-4c61-948a-d19beba6e345 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:19:59 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:19:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:59 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345 1073741824 Jun 15 07:19:59 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:00 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345 1073741824" returned: 0 in 0.861s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:00 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345 Jun 15 07:20:00 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] Acquiring lock "cinder-9ff77065-9ec2-4614-9028-dc5a74751c53-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] Lock "cinder-9ff77065-9ec2-4614-9028-dc5a74751c53-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] Acquiring lock "cinder-quobyte-9ff77065-9ec2-4614-9028-dc5a74751c53" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] Lock "cinder-quobyte-9ff77065-9ec2-4614-9028-dc5a74751c53" acquired by "delete_volume" :: waited 0.021s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:00 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[482768ba-3f21-4b1c-9c88-e8dcb5b2ca2d]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9ff77065-9ec2-4614-9028-dc5a74751c53 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:00 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9ff77065-9ec2-4614-9028-dc5a74751c53 Jun 15 07:20:00 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:01 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345" returned: 0 in 0.648s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:01 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:20:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2529f349-25d6-4c04-b1fa-1f948311840e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef362eb5-f8b9-4c61-948a-d19beba6e345', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd97b2a-fd6b-48c1-ae73-dbe5ac6d75f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:01 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Volume volume-ef362eb5-f8b9-4c61-948a-d19beba6e345 (ef362eb5-f8b9-4c61-948a-d19beba6e345): created successfully Jun 15 07:20:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd97b2a-fd6b-48c1-ae73-dbe5ac6d75f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Flow 'volume_create_manager' (29af57a5-745d-4a51-a7cc-e84190afd746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:20:01 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-49679a88-d4f0-4609-90fe-4e2953c5175b req-ddf5f873-8130-4db6-8340-9c9072add4de tempest-VolumesSnapshotsTestJSON-2092576708 None] Created volume successfully. Jun 15 07:20:01 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9ff77065-9ec2-4614-9028-dc5a74751c53" returned: 0 in 0.762s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9ff77065-9ec2-4614-9028-dc5a74751c53 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:01 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9ff77065-9ec2-4614-9028-dc5a74751c53 Jun 15 07:20:01 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] Creating offline snapshot f9137e9d-55ea-449e-b8ce-790ecf76e205 of volume ef362eb5-f8b9-4c61-948a-d19beba6e345 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:20:02 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e607ff77-b425-4bee-8817-ab0dc51f34d6]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:02 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345 Jun 15 07:20:02 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:02 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9ff77065-9ec2-4614-9028-dc5a74751c53" returned: 0 in 0.855s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:02 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] Lock "cinder-quobyte-9ff77065-9ec2-4614-9028-dc5a74751c53" released by "delete_volume" :: held 1.678s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:02 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] Created reservations ['1836efb7-dca1-4afb-bcca-b9c6c430f157', 'b27f995d-0604-4834-abf1-3a394ab50ebb', 'df9453a7-2c60-4734-b677-a552d8976909', 'fb4ff742-4b9b-4620-904d-e6a2f1d8cac1'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:20:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:02 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:20:02 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:03 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] Acquiring lock "cinder-408f8812-eb15-4dac-a5ed-9e3cc966665a-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:03 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] Lock "cinder-408f8812-eb15-4dac-a5ed-9e3cc966665a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:03 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345" returned: 0 in 0.854s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:03 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205 1G Jun 15 07:20:03 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:03 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] Acquiring lock "cinder-quobyte-408f8812-eb15-4dac-a5ed-9e3cc966665a" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:03 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] Lock "cinder-quobyte-408f8812-eb15-4dac-a5ed-9e3cc966665a" acquired by "delete_volume" :: waited 0.036s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:03 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c62f5c2-8313-4915-bf73-c412cb473ce6]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-408f8812-eb15-4dac-a5ed-9e3cc966665a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:03 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-408f8812-eb15-4dac-a5ed-9e3cc966665a Jun 15 07:20:03 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:03 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.739s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:03 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:20:03 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] Deleted volume successfully. Jun 15 07:20:03 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cdf3d783-5e31-4e8b-ae35-6228cd70861e tempest-VolumesTestJSON-1674985507 None] Lock "cinder-9ff77065-9ec2-4614-9028-dc5a74751c53-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:04 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205 1G" returned: 0 in 0.941s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef362eb5-f8b9-4c61-948a-d19beba6e345 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:04 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef362eb5-f8b9-4c61-948a-d19beba6e345 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205 Jun 15 07:20:04 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:04 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-408f8812-eb15-4dac-a5ed-9e3cc966665a" returned: 0 in 0.848s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-408f8812-eb15-4dac-a5ed-9e3cc966665a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:04 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-408f8812-eb15-4dac-a5ed-9e3cc966665a Jun 15 07:20:04 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:04 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef362eb5-f8b9-4c61-948a-d19beba6e345 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205" returned: 0 in 0.740s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:04 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205 is being set with open permissions: ugo+rw Jun 15 07:20:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:04 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205 Jun 15 07:20:04 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:04 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-408f8812-eb15-4dac-a5ed-9e3cc966665a" returned: 0 in 0.766s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] Acquiring lock "cinder-c6f3dd3c-632a-4e16-bfcd-356fb6209674-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] Lock "cinder-quobyte-408f8812-eb15-4dac-a5ed-9e3cc966665a" released by "delete_volume" :: held 1.683s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] Lock "cinder-c6f3dd3c-632a-4e16-bfcd-356fb6209674-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] Acquiring lock "cinder-quobyte-c6f3dd3c-632a-4e16-bfcd-356fb6209674" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] Lock "cinder-quobyte-c6f3dd3c-632a-4e16-bfcd-356fb6209674" acquired by "delete_volume" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:04 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32e96c4-3b48-4c18-a36b-9826adf22e18]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:04 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] Created reservations ['3f3a57e8-60b1-4ea7-a251-15328d29a4fe', '37c8abc9-0608-4ec6-918e-3a96fbf6440d', '9b86f91c-1c63-42af-8cf7-6dc91db9441e', 'cdfc596d-90f4-4bea-bdca-5f601d63bddd'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:20:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:05 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:20:05 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:05 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674 Jun 15 07:20:05 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] Acquiring lock "cinder-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] Lock "cinder-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:05 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205" returned: 0 in 0.679s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] Acquiring lock "cinder-quobyte-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:05 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.info Jun 15 07:20:05 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] Lock "cinder-quobyte-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc" acquired by "delete_volume" :: waited 0.040s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:05 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af8afcb-a017-414e-a446-ea2b02830ce2]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:05 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc Jun 15 07:20:05 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:06 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:06 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.082s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674" returned: 0 in 1.202s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:06 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:20:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:06 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] Deleted volume successfully. Jun 15 07:20:06 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674 Jun 15 07:20:06 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:06 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-283499a2-3342-4156-a4fb-e68e1dc2f304 tempest-VolumesTestJSON-1674985507 None] Lock "cinder-408f8812-eb15-4dac-a5ed-9e3cc966665a-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:06 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.info" returned: 0 in 1.217s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:06 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.info is being set with open permissions: ugo+rw Jun 15 07:20:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:06 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.info Jun 15 07:20:06 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:06 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc" returned: 0 in 1.265s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:06 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc Jun 15 07:20:06 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:07 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6f3dd3c-632a-4e16-bfcd-356fb6209674" returned: 0 in 1.053s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] Lock "cinder-quobyte-c6f3dd3c-632a-4e16-bfcd-356fb6209674" released by "delete_volume" :: held 2.323s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] Created reservations ['1eceea05-add1-4860-8651-16ab2b983c6c', '76893cc0-2732-4dba-a9fb-119e5b7db284', '6b76fff4-9552-4b64-8886-0fd3e68c9748', 'ed08f80e-476b-481b-83f2-72b448c98b0e'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:07 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:20:07 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:07 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.info" returned: 0 in 0.781s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.408s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:07 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-40c9e5ca-da6e-4108-bc3d-a6be36138584 req-e4db0df5-24b5-4fda-ab53-0518f04d7781 tempest-VolumesSnapshotsTestJSON-2092576708 None] Create snapshot completed successfully Jun 15 07:20:07 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc" returned: 0 in 0.708s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] Lock "cinder-quobyte-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc" released by "delete_volume" :: held 2.062s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] Created reservations ['bbafe19d-fbe2-4a09-9617-c802ea01555a', '62aa7980-67b2-482f-895e-cf429e074a3e', '1e051f3d-09b4-428a-a399-c739a54eba6d', 'b716260e-a67a-46af-9c39-fcc212015557'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:07 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:20:07 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Acquiring lock "cinder-f9137e9d-55ea-449e-b8ce-790ecf76e205-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "cinder-f9137e9d-55ea-449e-b8ce-790ecf76e205-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Acquiring lock "cinder-quobyte-ef362eb5-f8b9-4c61-948a-d19beba6e345" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "cinder-quobyte-ef362eb5-f8b9-4c61-948a-d19beba6e345" acquired by "delete_snapshot" :: waited 0.031s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Acquiring lock "cinder-quobyte-f9137e9d-55ea-449e-b8ce-790ecf76e205" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "cinder-quobyte-f9137e9d-55ea-449e-b8ce-790ecf76e205" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Deleting offline snapshot f9137e9d-55ea-449e-b8ce-790ecf76e205 of volume ef362eb5-f8b9-4c61-948a-d19beba6e345 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] snapshot_file for this snap is: volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7d1acf-aa3a-4d18-b740-bb48df498a83]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:08 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205 Jun 15 07:20:08 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:08 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.833s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:20:08 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] Deleted volume successfully. Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1acde172-22a8-40d1-8d6a-016842588e1c tempest-ServerActionsTestOtherA-2108723054 None] Lock "cinder-c6f3dd3c-632a-4e16-bfcd-356fb6209674-delete_volume" released by "delete_volume" :: held 3.481s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:08 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.806s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:20:08 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] Deleted volume successfully. Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9e2c2fcd-5eb1-48d0-a2bc-9c07af675bae tempest-VolumesTestJSON-1674985507 None] Lock "cinder-ff4b59b7-a790-4e7d-a7ab-192fd338b5dc-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:08 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205" returned: 0 in 0.818s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef362eb5-f8b9-4c61-948a-d19beba6e345(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:20:09 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a90c96-4599-41b7-ab56-adb0c7e15c1f]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:09 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345 Jun 15 07:20:09 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:10 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345" returned: 0 in 1.263s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:10 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205 Jun 15 07:20:10 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:11 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205" returned: 0 in 1.159s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:11 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205 Jun 15 07:20:11 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:12 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345.f9137e9d-55ea-449e-b8ce-790ecf76e205" returned: 0 in 0.863s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:12 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=75,cinder:INSERT=28,cinder:UPDATE=93,cinder:DELETE=11 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:20:12 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=74,cinder:UPDATE=106,cinder:DELETE=7,cinder:INSERT=17 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:20:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "cinder-quobyte-f9137e9d-55ea-449e-b8ce-790ecf76e205" released by "_delete_snapshot" :: held 4.284s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "cinder-quobyte-ef362eb5-f8b9-4c61-948a-d19beba6e345" released by "delete_snapshot" :: held 4.333s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:12 devstack cinder-volume[92129]: WARNING cinder.quota [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:20:12 devstack cinder-volume[92129]: DEBUG cinder.quota [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Created reservations ['ce21d42b-759c-41f1-a0f7-9ca1231f1731', 'f1cff424-0243-4952-8cb4-ac666a5e68ec', '5139bfd4-9b54-4b96-8557-b3e0f578587a', 'e02938d3-9ba8-429c-8957-e01bdb5bf91c'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:20:12 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Delete snapshot completed successfully. Jun 15 07:20:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-c32b4307-bde1-42dd-8799-46f3a8e0c5d1 req-4ba725e8-14bb-42ea-811c-3ceb4322bd4c tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "cinder-f9137e9d-55ea-449e-b8ce-790ecf76e205-delete_snapshot" released by "delete_snapshot" :: held 4.500s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] Acquiring lock "cinder-ef362eb5-f8b9-4c61-948a-d19beba6e345-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "cinder-ef362eb5-f8b9-4c61-948a-d19beba6e345-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] Acquiring lock "cinder-quobyte-ef362eb5-f8b9-4c61-948a-d19beba6e345" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "cinder-quobyte-ef362eb5-f8b9-4c61-948a-d19beba6e345" acquired by "delete_volume" :: waited 0.015s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:13 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee02b56-e453-4810-ac37-458426852bdc]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:13 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345 Jun 15 07:20:13 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:20:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:13 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:20:13 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:14 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.084s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:15 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:20:15 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345" returned: 0 in 1.307s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:15 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:20:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 8 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:20:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:20:15 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345 Jun 15 07:20:15 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:16 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ef362eb5-f8b9-4c61-948a-d19beba6e345" returned: 0 in 1.007s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "cinder-quobyte-ef362eb5-f8b9-4c61-948a-d19beba6e345" released by "delete_volume" :: held 2.409s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:16 devstack cinder-volume[92129]: DEBUG cinder.quota [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] Created reservations ['f1650c4f-9420-4b58-8075-46ef9fa7f79a', '1c2b9082-ee5e-47b8-a9ac-ac24e0067712', 'eea47942-54aa-4217-8d9e-0b152ac74651', '19a219dd-878f-4de2-bd56-284213e6b63a'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:20:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:16 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:20:16 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:17 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.785s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:17 devstack cinder-volume[92129]: DEBUG cinder.manager [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:20:17 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] Deleted volume successfully. Jun 15 07:20:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-2ca6af59-007b-43fe-891e-9435327bcb63 req-e55292bd-d921-4846-a435-0abad44eedf2 tempest-VolumesSnapshotsTestJSON-2092576708 None] Lock "cinder-ef362eb5-f8b9-4c61-948a-d19beba6e345-delete_volume" released by "delete_volume" :: held 3.520s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:21 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-3abba743-04f9-4eaa-a900-c49327a8dde3 tempest-GroupsTest-159500073 None] Group tempest-Group1-756201972: creating Jun 15 07:20:21 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-3abba743-04f9-4eaa-a900-c49327a8dde3 tempest-GroupsTest-159500073 None] Group tempest-Group1-756201972: created successfully Jun 15 07:20:21 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-3abba743-04f9-4eaa-a900-c49327a8dde3 tempest-GroupsTest-159500073 None] Create group completed successfully. Jun 15 07:20:22 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:20:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Flow 'volume_create_manager' (300af3b7-1c70-485e-bf66-8cd67361fdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:20:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9367d8a8-360d-4f07-8493-ccc9c3460e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9367d8a8-360d-4f07-8493-ccc9c3460e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-165817736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2402e3fe-bf88-4e00-8f1f-094aef94b1f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fff09e1c9ffa476f90a83e0c6c5de0dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:23Z,use_quota=True,user_id='5ccd0989554f4ea58a05009aecf4c3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91a9996-1886-4705-a9ea-a48aa2918afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91a9996-1886-4705-a9ea-a48aa2918afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8f6fa8-5397-4de6-8259-ec62d3c590c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8f6fa8-5397-4de6-8259-ec62d3c590c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2402e3fe-bf88-4e00-8f1f-094aef94b1f1', 'volume_name': 'volume-2402e3fe-bf88-4e00-8f1f-094aef94b1f1', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6d1437-92ff-4520-b325-6a649a5533d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6d1437-92ff-4520-b325-6a649a5533d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e9bdc63-4517-44ad-98de-8ef237edc3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:23 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Volume 2402e3fe-bf88-4e00-8f1f-094aef94b1f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2402e3fe-bf88-4e00-8f1f-094aef94b1f1', 'volume_size': 1} Jun 15 07:20:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-165817736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2402e3fe-bf88-4e00-8f1f-094aef94b1f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fff09e1c9ffa476f90a83e0c6c5de0dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:23Z,use_quota=True,user_id='5ccd0989554f4ea58a05009aecf4c3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:20:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Creating volume 2402e3fe-bf88-4e00-8f1f-094aef94b1f1 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:20:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:20:23 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:20:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2402e3fe-bf88-4e00-8f1f-094aef94b1f1 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:23 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2402e3fe-bf88-4e00-8f1f-094aef94b1f1 1073741824 Jun 15 07:20:23 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:23 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-dda63251-c1a6-4921-940c-b26aeab525ed tempest-GroupsTest-159500073 None] Group tempest-Group2-1337073266: creating Jun 15 07:20:23 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-dda63251-c1a6-4921-940c-b26aeab525ed tempest-GroupsTest-159500073 None] Group tempest-Group2-1337073266: created successfully Jun 15 07:20:23 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-dda63251-c1a6-4921-940c-b26aeab525ed tempest-GroupsTest-159500073 None] Create group completed successfully. Jun 15 07:20:23 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2402e3fe-bf88-4e00-8f1f-094aef94b1f1 1073741824" returned: 0 in 0.933s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2402e3fe-bf88-4e00-8f1f-094aef94b1f1 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:24 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2402e3fe-bf88-4e00-8f1f-094aef94b1f1 Jun 15 07:20:24 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:24 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2402e3fe-bf88-4e00-8f1f-094aef94b1f1" returned: 0 in 0.759s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e9bdc63-4517-44ad-98de-8ef237edc3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2402e3fe-bf88-4e00-8f1f-094aef94b1f1', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace9b354-140a-4988-b929-654896830a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:24 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Volume volume-2402e3fe-bf88-4e00-8f1f-094aef94b1f1 (2402e3fe-bf88-4e00-8f1f-094aef94b1f1): created successfully Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace9b354-140a-4988-b929-654896830a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Flow 'volume_create_manager' (300af3b7-1c70-485e-bf66-8cd67361fdcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:20:24 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-09b48e92-7473-4b51-8d9a-3f141e7fb1f6 req-b52b0a1d-df2b-40e0-b3c6-11836baaa31e tempest-VolumesGetTestJSON-994539944 None] Created volume successfully. Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Flow 'volume_create_manager' (7b01d7f9-e7f1-4215-bb1e-36da6161e21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a7fd86-6ec4-4d23-bf73-f38eea55e884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a7fd86-6ec4-4d23-bf73-f38eea55e884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-587949748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15327cdb-24f6-4d5a-9ba4-62025f5bda8d,host='devstack@QuobyteHD#QuobyteHD',id=d6112718-f0f8-4e77-a668-111585a2f418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2a0d8aa2284d31a79cb430a1ab9eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:25Z,use_quota=True,user_id='da3a9bb963cf41c8abc9e102bcd4eecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c10cbdc8-067e-4981-b792-eff47db574db),volume_type_id=c10cbdc8-067e-4981-b792-eff47db574db)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506da033-782a-49b5-af8d-543f270e1a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506da033-782a-49b5-af8d-543f270e1a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1338c3fa-1a9c-4b5b-920d-d25c59530ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1338c3fa-1a9c-4b5b-920d-d25c59530ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6112718-f0f8-4e77-a668-111585a2f418', 'volume_name': 'volume-d6112718-f0f8-4e77-a668-111585a2f418', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb262cd8-f5ac-41f3-a742-bfe8a6948157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb262cd8-f5ac-41f3-a742-bfe8a6948157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ab5516-883c-4fe1-a9b4-3151f9b7f764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:24 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Volume d6112718-f0f8-4e77-a668-111585a2f418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6112718-f0f8-4e77-a668-111585a2f418', 'volume_size': 1} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=15327cdb-24f6-4d5a-9ba4-62025f5bda8d,created_at=2026-06-15T05:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-587949748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15327cdb-24f6-4d5a-9ba4-62025f5bda8d,host='devstack@QuobyteHD#QuobyteHD',id=d6112718-f0f8-4e77-a668-111585a2f418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2a0d8aa2284d31a79cb430a1ab9eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:25Z,use_quota=True,user_id='da3a9bb963cf41c8abc9e102bcd4eecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c10cbdc8-067e-4981-b792-eff47db574db),volume_type_id=c10cbdc8-067e-4981-b792-eff47db574db)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:20:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Creating volume d6112718-f0f8-4e77-a668-111585a2f418 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:20:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:20:25 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:20:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d6112718-f0f8-4e77-a668-111585a2f418 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:25 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d6112718-f0f8-4e77-a668-111585a2f418 1073741824 Jun 15 07:20:25 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:25 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] Acquiring lock "cinder-2402e3fe-bf88-4e00-8f1f-094aef94b1f1-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:25 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] Lock "cinder-2402e3fe-bf88-4e00-8f1f-094aef94b1f1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:25 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d6112718-f0f8-4e77-a668-111585a2f418 1073741824" returned: 0 in 0.943s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] Acquiring lock "cinder-quobyte-2402e3fe-bf88-4e00-8f1f-094aef94b1f1" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d6112718-f0f8-4e77-a668-111585a2f418 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] Lock "cinder-quobyte-2402e3fe-bf88-4e00-8f1f-094aef94b1f1" acquired by "delete_volume" :: waited 0.049s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:26 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d6112718-f0f8-4e77-a668-111585a2f418 Jun 15 07:20:26 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:26 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[05476663-4b4e-4a0e-ac36-a7edfe0e276b]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2402e3fe-bf88-4e00-8f1f-094aef94b1f1 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:26 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2402e3fe-bf88-4e00-8f1f-094aef94b1f1 Jun 15 07:20:26 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:26 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d6112718-f0f8-4e77-a668-111585a2f418" returned: 0 in 0.813s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:20:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ab5516-883c-4fe1-a9b4-3151f9b7f764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6112718-f0f8-4e77-a668-111585a2f418', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8a400b-9728-4773-a478-1609a3a79f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:26 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Volume volume-d6112718-f0f8-4e77-a668-111585a2f418 (d6112718-f0f8-4e77-a668-111585a2f418): created successfully Jun 15 07:20:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8a400b-9728-4773-a478-1609a3a79f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Flow 'volume_create_manager' (7b01d7f9-e7f1-4215-bb1e-36da6161e21a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:20:26 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-cd24c7bf-48c9-4414-8cf2-eeccf95d6b7c tempest-GroupsTest-159500073 None] Created volume successfully. Jun 15 07:20:27 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2402e3fe-bf88-4e00-8f1f-094aef94b1f1" returned: 0 in 0.945s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2402e3fe-bf88-4e00-8f1f-094aef94b1f1 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:27 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2402e3fe-bf88-4e00-8f1f-094aef94b1f1 Jun 15 07:20:27 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] Acquiring lock "cinder-quobyte-d6112718-f0f8-4e77-a668-111585a2f418" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] Lock "cinder-quobyte-d6112718-f0f8-4e77-a668-111585a2f418" acquired by "delete_volume" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:27 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[775bb047-1a6f-4b9d-99f8-0b77f443ce73]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d6112718-f0f8-4e77-a668-111585a2f418 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:27 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d6112718-f0f8-4e77-a668-111585a2f418 Jun 15 07:20:27 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:27 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2402e3fe-bf88-4e00-8f1f-094aef94b1f1" returned: 0 in 0.896s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] Lock "cinder-quobyte-2402e3fe-bf88-4e00-8f1f-094aef94b1f1" released by "delete_volume" :: held 1.907s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:28 devstack cinder-volume[92129]: DEBUG cinder.quota [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] Created reservations ['92098b29-2769-4e05-944a-2e87b3109404', '8e0c7ad5-e41b-484d-8a18-0213f9e04482', '3622d596-45aa-4694-8e5c-3ab04802bb8b', '675c87ed-0f92-4adc-a77e-a499ae0dfebd'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:20:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:28 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:20:28 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:28 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.744s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:28 devstack cinder-volume[92129]: DEBUG cinder.manager [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:20:28 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] Deleted volume successfully. Jun 15 07:20:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-4fc759f8-9803-4614-b7c4-ab4dfc6592ee req-05150d02-596b-43d0-bb4f-287797763a89 tempest-VolumesGetTestJSON-994539944 None] Lock "cinder-2402e3fe-bf88-4e00-8f1f-094aef94b1f1-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:28 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d6112718-f0f8-4e77-a668-111585a2f418" returned: 0 in 1.182s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d6112718-f0f8-4e77-a668-111585a2f418 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:28 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d6112718-f0f8-4e77-a668-111585a2f418 Jun 15 07:20:28 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:29 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d6112718-f0f8-4e77-a668-111585a2f418" returned: 0 in 0.668s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:29 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] Lock "cinder-quobyte-d6112718-f0f8-4e77-a668-111585a2f418" released by "delete_volume" :: held 1.913s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:29 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] Created reservations ['e0f0f909-f221-489c-a9a2-d6d622c0f47c'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:20:29 devstack cinder-volume[92129]: WARNING cinder.quota [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-528279045 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-528279045, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:20:29 devstack cinder-volume[92129]: WARNING cinder.quota [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-528279045 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-528279045, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:20:29 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] Created reservations ['e1bbd968-111f-4272-946f-42e31e77acda', '1c2bbc66-5f46-41d0-ad32-ea7dfecb74c8', '4922eaca-623f-4e1e-9f57-23a1dd83e5d1', 'ccd7bb03-1869-484d-ad03-ecd8011b24ae'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:20:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:29 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:20:29 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:30 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-83371820-150c-4303-9c87-79afa839bde6 tempest-GroupsTest-159500073 None] Created reservations ['a7fa1d1a-693b-44f4-87b8-cc3d11e998e6'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:20:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-83371820-150c-4303-9c87-79afa839bde6 tempest-GroupsTest-159500073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-83371820-150c-4303-9c87-79afa839bde6 tempest-GroupsTest-159500073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-83371820-150c-4303-9c87-79afa839bde6 tempest-GroupsTest-159500073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-83371820-150c-4303-9c87-79afa839bde6 tempest-GroupsTest-159500073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-83371820-150c-4303-9c87-79afa839bde6 tempest-GroupsTest-159500073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-83371820-150c-4303-9c87-79afa839bde6 tempest-GroupsTest-159500073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:30 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:20:30 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:30 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.794s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:30 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:20:30 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-467bbd72-ff17-49b3-80d8-28ade6d48156 tempest-GroupsTest-159500073 None] Delete group completed successfully. Jun 15 07:20:30 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-83371820-150c-4303-9c87-79afa839bde6 tempest-GroupsTest-159500073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.700s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:30 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-83371820-150c-4303-9c87-79afa839bde6 tempest-GroupsTest-159500073 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:20:30 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-83371820-150c-4303-9c87-79afa839bde6 tempest-GroupsTest-159500073 None] Delete group completed successfully. Jun 15 07:20:31 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f4b47105-1ef3-42ee-9ef7-bc3939698724 tempest-GroupsTest-159500073 None] Group tempest-GroupsTest-Group-463637475: creating Jun 15 07:20:31 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f4b47105-1ef3-42ee-9ef7-bc3939698724 tempest-GroupsTest-159500073 None] Group tempest-GroupsTest-Group-463637475: created successfully Jun 15 07:20:31 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f4b47105-1ef3-42ee-9ef7-bc3939698724 tempest-GroupsTest-159500073 None] Create group completed successfully. Jun 15 07:20:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6ebc9f13-671f-44fe-b4f1-69b55cce0cd5 tempest-BackendsCapabilitiesAdminTestsJSON-410407349 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578430175781, 'free_capacity_gb': 1775.7578430175781, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92129) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6716ce39-0c37-43a6-8a2a-7d98027661c3 tempest-BackendsCapabilitiesAdminTestsJSON-410407349 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578430175781, 'free_capacity_gb': 1775.7578430175781, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92129) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Flow 'volume_create_manager' (e028ba07-8681-4860-a5f4-5f10e825a782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d839e2-a428-4053-8a69-113f7b386e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d839e2-a428-4053-8a69-113f7b386e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1611526561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cfa2eb01-5c3d-454f-8b82-ba5677a4b856,host='devstack@QuobyteHD#QuobyteHD',id=9eaae722-a1bc-465b-b58b-4a774e7d5479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2a0d8aa2284d31a79cb430a1ab9eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:33Z,use_quota=True,user_id='da3a9bb963cf41c8abc9e102bcd4eecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(551c26fd-64f2-4b33-a79d-4b0e3f50bdb5),volume_type_id=551c26fd-64f2-4b33-a79d-4b0e3f50bdb5)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28053cdb-ec5a-4fe3-bf99-f578a297d815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28053cdb-ec5a-4fe3-bf99-f578a297d815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9315c999-da00-4a6e-91db-fbbf6a796e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9315c999-da00-4a6e-91db-fbbf6a796e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eaae722-a1bc-465b-b58b-4a774e7d5479', 'volume_name': 'volume-9eaae722-a1bc-465b-b58b-4a774e7d5479', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849a5554-f9db-42a0-a099-c1bc70815720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849a5554-f9db-42a0-a099-c1bc70815720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45180c9-edb9-4ab0-b9d0-0d1f9d99286c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:33 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Volume 9eaae722-a1bc-465b-b58b-4a774e7d5479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eaae722-a1bc-465b-b58b-4a774e7d5479', 'volume_size': 1} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cfa2eb01-5c3d-454f-8b82-ba5677a4b856,created_at=2026-06-15T05:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1611526561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cfa2eb01-5c3d-454f-8b82-ba5677a4b856,host='devstack@QuobyteHD#QuobyteHD',id=9eaae722-a1bc-465b-b58b-4a774e7d5479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2a0d8aa2284d31a79cb430a1ab9eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:33Z,use_quota=True,user_id='da3a9bb963cf41c8abc9e102bcd4eecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(551c26fd-64f2-4b33-a79d-4b0e3f50bdb5),volume_type_id=551c26fd-64f2-4b33-a79d-4b0e3f50bdb5)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Creating volume 9eaae722-a1bc-465b-b58b-4a774e7d5479 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:20:33 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:20:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9eaae722-a1bc-465b-b58b-4a774e7d5479 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:33 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9eaae722-a1bc-465b-b58b-4a774e7d5479 1073741824 Jun 15 07:20:33 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:34 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9eaae722-a1bc-465b-b58b-4a774e7d5479 1073741824" returned: 0 in 0.893s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9eaae722-a1bc-465b-b58b-4a774e7d5479 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:34 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9eaae722-a1bc-465b-b58b-4a774e7d5479 Jun 15 07:20:34 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:35 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9eaae722-a1bc-465b-b58b-4a774e7d5479" returned: 0 in 0.632s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:35 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:20:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45180c9-edb9-4ab0-b9d0-0d1f9d99286c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eaae722-a1bc-465b-b58b-4a774e7d5479', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3149a3bd-462d-4b3c-98e4-5d4de12cbce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:35 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Volume volume-9eaae722-a1bc-465b-b58b-4a774e7d5479 (9eaae722-a1bc-465b-b58b-4a774e7d5479): created successfully Jun 15 07:20:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3149a3bd-462d-4b3c-98e4-5d4de12cbce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Flow 'volume_create_manager' (e028ba07-8681-4860-a5f4-5f10e825a782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:20:35 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-29598786-7a98-4aa6-b297-e8ddac373b17 tempest-GroupsTest-159500073 None] Created volume successfully. Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Flow 'volume_create_manager' (78f0a2e2-ac66-41f7-b307-71c29e20e503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81072496-1b0b-461a-b8f2-5c707e4e537f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81072496-1b0b-461a-b8f2-5c707e4e537f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1294517023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cfa2eb01-5c3d-454f-8b82-ba5677a4b856,host='devstack@QuobyteHD#QuobyteHD',id=5150768d-e63c-4892-843b-04dc0429e602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2a0d8aa2284d31a79cb430a1ab9eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:36Z,use_quota=True,user_id='da3a9bb963cf41c8abc9e102bcd4eecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(551c26fd-64f2-4b33-a79d-4b0e3f50bdb5),volume_type_id=551c26fd-64f2-4b33-a79d-4b0e3f50bdb5)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc917a87-1977-4953-a986-160daa479e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc917a87-1977-4953-a986-160daa479e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569ed9f3-e160-4919-a6c8-c4887e71c1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569ed9f3-e160-4919-a6c8-c4887e71c1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5150768d-e63c-4892-843b-04dc0429e602', 'volume_name': 'volume-5150768d-e63c-4892-843b-04dc0429e602', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3083a6-acb5-47f6-ba5f-501697f21666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3083a6-acb5-47f6-ba5f-501697f21666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf03782f-d174-4fcb-90d0-7344d7fb2771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:36 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Volume 5150768d-e63c-4892-843b-04dc0429e602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5150768d-e63c-4892-843b-04dc0429e602', 'volume_size': 1} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cfa2eb01-5c3d-454f-8b82-ba5677a4b856,created_at=2026-06-15T05:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1294517023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cfa2eb01-5c3d-454f-8b82-ba5677a4b856,host='devstack@QuobyteHD#QuobyteHD',id=5150768d-e63c-4892-843b-04dc0429e602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2a0d8aa2284d31a79cb430a1ab9eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:36Z,use_quota=True,user_id='da3a9bb963cf41c8abc9e102bcd4eecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(551c26fd-64f2-4b33-a79d-4b0e3f50bdb5),volume_type_id=551c26fd-64f2-4b33-a79d-4b0e3f50bdb5)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Creating volume 5150768d-e63c-4892-843b-04dc0429e602 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:20:36 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:20:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5150768d-e63c-4892-843b-04dc0429e602 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:36 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5150768d-e63c-4892-843b-04dc0429e602 1073741824 Jun 15 07:20:36 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:37 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5150768d-e63c-4892-843b-04dc0429e602 1073741824" returned: 0 in 1.103s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5150768d-e63c-4892-843b-04dc0429e602 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:37 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5150768d-e63c-4892-843b-04dc0429e602 Jun 15 07:20:37 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:38 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5150768d-e63c-4892-843b-04dc0429e602" returned: 0 in 0.621s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:20:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:38 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf03782f-d174-4fcb-90d0-7344d7fb2771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5150768d-e63c-4892-843b-04dc0429e602', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:38 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cf2cc0-b335-4510-bb12-7c48170d924f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:38 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Volume volume-5150768d-e63c-4892-843b-04dc0429e602 (5150768d-e63c-4892-843b-04dc0429e602): created successfully Jun 15 07:20:38 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cf2cc0-b335-4510-bb12-7c48170d924f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:38 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Flow 'volume_create_manager' (78f0a2e2-ac66-41f7-b307-71c29e20e503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:20:38 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-917da34e-29a5-464d-aa3e-2087503abd0a tempest-GroupsTest-159500073 None] Created volume successfully. Jun 15 07:20:38 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-6c43189f-6ebf-4b45-a482-91ed8936cfb2 tempest-GroupsTest-159500073 None] Update group completed successfully. Jun 15 07:20:38 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-fc059e10-6cab-49a7-8036-d53e03fe96fc tempest-GroupsV314Test-778022445 None] Group tempest-GroupsV314Test-Group-1000074468: creating Jun 15 07:20:38 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-fc059e10-6cab-49a7-8036-d53e03fe96fc tempest-GroupsV314Test-778022445 None] Group tempest-GroupsV314Test-Group-1000074468: created successfully Jun 15 07:20:38 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-fc059e10-6cab-49a7-8036-d53e03fe96fc tempest-GroupsV314Test-778022445 None] Create group completed successfully. Jun 15 07:20:39 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-cb5ac59d-1091-4d2f-b93a-c110da3a7520 tempest-GroupSnapshotsTest-869728579 None] Group tempest-GroupSnapshotsTest-Group-541122457: creating Jun 15 07:20:39 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-cb5ac59d-1091-4d2f-b93a-c110da3a7520 tempest-GroupSnapshotsTest-869728579 None] Group tempest-GroupSnapshotsTest-Group-541122457: created successfully Jun 15 07:20:39 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-cb5ac59d-1091-4d2f-b93a-c110da3a7520 tempest-GroupSnapshotsTest-869728579 None] Create group completed successfully. Jun 15 07:20:40 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-b2a60b76-a3b9-4d3d-87d1-a50d606fc680 tempest-GroupsTest-159500073 None] Update group completed successfully. Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Flow 'volume_create_manager' (800a90fb-7798-419c-9da3-e01360a82c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c13538-408b-47ec-b41d-8b53507946db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c13538-408b-47ec-b41d-8b53507946db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1887457015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=763aa8c9-cd06-497d-a26e-b243682c4113,host='devstack@QuobyteHD#QuobyteHD',id=c51a4e0f-e046-4e8d-afc2-f095d819a337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4df12b18e4438995bf1314d4440190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:41Z,use_quota=True,user_id='e595cee89d5840528095e9beead863f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9113a9b9-499a-451d-a5c9-06d4805ad788),volume_type_id=9113a9b9-499a-451d-a5c9-06d4805ad788)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce28b64-1b7d-49b8-a094-fd8616fa26c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce28b64-1b7d-49b8-a094-fd8616fa26c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e66e4e-926e-4895-a446-c71d8575615b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e66e4e-926e-4895-a446-c71d8575615b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c51a4e0f-e046-4e8d-afc2-f095d819a337', 'volume_name': 'volume-c51a4e0f-e046-4e8d-afc2-f095d819a337', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (133c130c-26f0-45a7-b1c2-f88e4c6ec753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (133c130c-26f0-45a7-b1c2-f88e4c6ec753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf2e472-6c44-432a-aa25-a70b408bde58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:40 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Volume c51a4e0f-e046-4e8d-afc2-f095d819a337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c51a4e0f-e046-4e8d-afc2-f095d819a337', 'volume_size': 1} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=763aa8c9-cd06-497d-a26e-b243682c4113,created_at=2026-06-15T05:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1887457015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=763aa8c9-cd06-497d-a26e-b243682c4113,host='devstack@QuobyteHD#QuobyteHD',id=c51a4e0f-e046-4e8d-afc2-f095d819a337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4df12b18e4438995bf1314d4440190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:41Z,use_quota=True,user_id='e595cee89d5840528095e9beead863f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9113a9b9-499a-451d-a5c9-06d4805ad788),volume_type_id=9113a9b9-499a-451d-a5c9-06d4805ad788)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Creating volume c51a4e0f-e046-4e8d-afc2-f095d819a337 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:20:40 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:20:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:40 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 1073741824 Jun 15 07:20:40 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Flow 'volume_create_manager' (0fceb25b-7ed4-4835-af65-31f5289ee3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8772bfe0-130e-45dc-8e8c-c2ef927df227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8772bfe0-130e-45dc-8e8c-c2ef927df227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-886431517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51542aac-05e5-441b-9bde-ccc3d42debe4,host='devstack@QuobyteHD#QuobyteHD',id=10a7c633-7951-4683-8c9f-df2313467769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507aaf4064d14210ae90520f1875db68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:41Z,use_quota=True,user_id='a2cde9e162384edbaf95a66df9db0916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93f90d8a-0e3b-4923-96e6-10106d1fde54),volume_type_id=93f90d8a-0e3b-4923-96e6-10106d1fde54)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e65b234-ea30-4205-81c7-717b6d5b0e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e65b234-ea30-4205-81c7-717b6d5b0e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f5d712-8d27-4cbb-adb0-844623d58dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f5d712-8d27-4cbb-adb0-844623d58dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10a7c633-7951-4683-8c9f-df2313467769', 'volume_name': 'volume-10a7c633-7951-4683-8c9f-df2313467769', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6268ba-27f4-4ee3-a946-eae39115b845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6268ba-27f4-4ee3-a946-eae39115b845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13c41ea-f283-4676-a5cb-8eac407307ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:41 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Volume 10a7c633-7951-4683-8c9f-df2313467769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10a7c633-7951-4683-8c9f-df2313467769', 'volume_size': 1} Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Acquiring lock "cinder-quobyte-5150768d-e63c-4892-843b-04dc0429e602" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Lock "cinder-quobyte-5150768d-e63c-4892-843b-04dc0429e602" acquired by "delete_volume" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cb6478-8312-4155-9d97-f9cf1bf1b32a]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5150768d-e63c-4892-843b-04dc0429e602 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:41 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 1073741824" returned: 0 in 0.972s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:41 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5150768d-e63c-4892-843b-04dc0429e602 Jun 15 07:20:41 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:41 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 Jun 15 07:20:41 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:42 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337" returned: 0 in 0.786s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.104s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=51542aac-05e5-441b-9bde-ccc3d42debe4,created_at=2026-06-15T05:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-886431517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51542aac-05e5-441b-9bde-ccc3d42debe4,host='devstack@QuobyteHD#QuobyteHD',id=10a7c633-7951-4683-8c9f-df2313467769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507aaf4064d14210ae90520f1875db68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:41Z,use_quota=True,user_id='a2cde9e162384edbaf95a66df9db0916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93f90d8a-0e3b-4923-96e6-10106d1fde54),volume_type_id=93f90d8a-0e3b-4923-96e6-10106d1fde54)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Creating volume 10a7c633-7951-4683-8c9f-df2313467769 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:20:42 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:20:42 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5150768d-e63c-4892-843b-04dc0429e602" returned: 0 in 0.944s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5150768d-e63c-4892-843b-04dc0429e602 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:42 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 1073741824 Jun 15 07:20:42 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:42 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5150768d-e63c-4892-843b-04dc0429e602 Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf2e472-6c44-432a-aa25-a70b408bde58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51a4e0f-e046-4e8d-afc2-f095d819a337', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:42 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac170ca-1606-42f0-8800-72401b6999b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:42 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Volume volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 (c51a4e0f-e046-4e8d-afc2-f095d819a337): created successfully Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac170ca-1606-42f0-8800-72401b6999b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Flow 'volume_create_manager' (800a90fb-7798-419c-9da3-e01360a82c7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:20:42 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-7e7797c9-9e24-400b-918b-a2ea9f3d92d2 tempest-GroupsV314Test-778022445 None] Created volume successfully. Jun 15 07:20:43 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5150768d-e63c-4892-843b-04dc0429e602" returned: 0 in 0.637s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Lock "cinder-quobyte-5150768d-e63c-4892-843b-04dc0429e602" released by "delete_volume" :: held 1.651s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Acquiring lock "cinder-quobyte-9eaae722-a1bc-465b-b58b-4a774e7d5479" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Lock "cinder-quobyte-9eaae722-a1bc-465b-b58b-4a774e7d5479" acquired by "delete_volume" :: waited 0.015s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:43 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9361c9f2-774a-4de8-8f80-6192c06ceb1c]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9eaae722-a1bc-465b-b58b-4a774e7d5479 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:43 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9eaae722-a1bc-465b-b58b-4a774e7d5479 Jun 15 07:20:43 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:43 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 1073741824" returned: 0 in 0.883s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:43 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 Jun 15 07:20:43 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:44 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9eaae722-a1bc-465b-b58b-4a774e7d5479" returned: 0 in 0.831s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9eaae722-a1bc-465b-b58b-4a774e7d5479 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:44 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9eaae722-a1bc-465b-b58b-4a774e7d5479 Jun 15 07:20:44 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:44 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769" returned: 0 in 0.744s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.248s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:44 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Cloning volume c51a4e0f-e046-4e8d-afc2-f095d819a337 to volume 08f88a26-b850-4434-8505-824ee553ab6e Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13c41ea-f283-4676-a5cb-8eac407307ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a7c633-7951-4683-8c9f-df2313467769', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956f4be2-9a6b-4872-b492-4f20e954a6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Creating offline snapshot c626863a-613c-4891-bbc1-e71323833d25 of volume c51a4e0f-e046-4e8d-afc2-f095d819a337 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:20:44 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Volume volume-10a7c633-7951-4683-8c9f-df2313467769 (10a7c633-7951-4683-8c9f-df2313467769): created successfully Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956f4be2-9a6b-4872-b492-4f20e954a6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Flow 'volume_create_manager' (0fceb25b-7ed4-4835-af65-31f5289ee3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4271e3c-2e35-4415-9a97-13abd6f8c9e7]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:44 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-a71b2529-070c-4cdb-abca-c9d38591cf8c tempest-GroupSnapshotsTest-869728579 None] Created volume successfully. Jun 15 07:20:44 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 Jun 15 07:20:44 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:44 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9eaae722-a1bc-465b-b58b-4a774e7d5479" returned: 0 in 0.654s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Lock "cinder-quobyte-9eaae722-a1bc-465b-b58b-4a774e7d5479" released by "delete_volume" :: held 1.530s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Created reservations ['2b898698-b998-4927-adf4-441b971b7325'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:20:44 devstack cinder-volume[92129]: WARNING cinder.quota [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1948924090 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1948924090, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:20:44 devstack cinder-volume[92129]: WARNING cinder.quota [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1948924090 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1948924090, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:20:44 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] GroupSnapshot 1189e2e4-d773-4adc-b784-3d9acc9e5067: creating. Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Created reservations ['8a0cba49-e17b-4a0e-86f0-abddab292b11', '5148b36a-b0f4-4fdc-a35d-e48e2c8f7210', '890eebb5-376a-45b1-9643-284a6f8638e0', '042958d7-8154-40df-83a3-f0b5b052aa99'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] Group snapshot 1189e2e4-d773-4adc-b784-3d9acc9e5067: creating. {{(pid=92129) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 15 07:20:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:45 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Created reservations ['cf317825-ebef-47da-b015-0c18feba8f0a', 'e7672cb9-921b-405e-a4c8-448d1c72e972', '764a0c37-bf57-4cc8-8524-4c4439efb2e5', '4eb08659-f2de-44e1-a386-c38eea7d72f0'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:20:45 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337" returned: 0 in 0.839s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:45 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25 1G Jun 15 07:20:45 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:45 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:20:45 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:45 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.693s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:45 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:20:45 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-b5b397ec-91dd-44e4-bc50-b03bff0fe77e tempest-GroupsTest-159500073 None] Delete group completed successfully. Jun 15 07:20:46 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25 1G" returned: 0 in 0.889s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:46 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25 Jun 15 07:20:46 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:46 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25" returned: 0 in 0.693s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:46 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25 is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:20:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:46 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25 Jun 15 07:20:46 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:47 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25" returned: 0 in 0.669s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:47 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.info Jun 15 07:20:47 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] Acquiring lock "cinder-47bc75fa-1794-4922-b119-a0893e1548bd-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "cinder-47bc75fa-1794-4922-b119-a0893e1548bd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] Acquiring lock "cinder-quobyte-47bc75fa-1794-4922-b119-a0893e1548bd" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "cinder-quobyte-47bc75fa-1794-4922-b119-a0893e1548bd" acquired by "delete_volume" :: waited 0.016s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:47 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a6dec3-b27e-4b6d-b979-bb2b33d9d811]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-47bc75fa-1794-4922-b119-a0893e1548bd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:48 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-47bc75fa-1794-4922-b119-a0893e1548bd Jun 15 07:20:48 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:48 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.info" returned: 0 in 0.745s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:48 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.info is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:20:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:48 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.info Jun 15 07:20:48 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:48 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-47bc75fa-1794-4922-b119-a0893e1548bd" returned: 0 in 0.819s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-47bc75fa-1794-4922-b119-a0893e1548bd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:48 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-47bc75fa-1794-4922-b119-a0893e1548bd Jun 15 07:20:48 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:48 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.info" returned: 0 in 0.664s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Acquiring lock "cinder-quobyte-08f88a26-b850-4434-8505-824ee553ab6e" by "_copy_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Lock "cinder-quobyte-08f88a26-b850-4434-8505-824ee553ab6e" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] snapshot: c626863a-613c-4891-bbc1-e71323833d25, volume: 08f88a26-b850-4434-8505-824ee553ab6e, {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:20:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:48 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[da26dcba-0733-4d6c-a8e7-c8e863e483ec]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:49 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25 Jun 15 07:20:49 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:49 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-47bc75fa-1794-4922-b119-a0893e1548bd" returned: 0 in 0.679s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "cinder-quobyte-47bc75fa-1794-4922-b119-a0893e1548bd" released by "delete_volume" :: held 1.554s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:49 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] Created reservations ['89e377b6-5c96-4d07-afb3-efa0036c435d', '18bc9581-1c94-4b00-9190-319ddd7c8386', 'b2f8ecf6-0fbf-4728-b88f-e95c4b9f6333', '167d24ba-6862-486a-8d07-3cde6d5ab64a'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:20:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:49 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:20:49 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:49 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25" returned: 0 in 0.878s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c51a4e0f-e046-4e8d-afc2-f095d819a337(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:20:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:20:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Creating direct copy from snapshot {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:20:49 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61a2a0f-5f04-4e01-baa9-dac47068ed4a]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:49 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 Jun 15 07:20:49 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] Acquiring lock "cinder-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "cinder-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] Acquiring lock "cinder-quobyte-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "cinder-quobyte-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e" acquired by "delete_volume" :: waited 0.026s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:50 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[25505a13-4365-4489-b069-95f8a062eb29]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:50 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.769s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:50 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:20:50 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] Deleted volume successfully. Jun 15 07:20:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-43068c37-220c-417a-b4ac-63154214f71a tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "cinder-47bc75fa-1794-4922-b119-a0893e1548bd-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:50 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e Jun 15 07:20:50 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:50 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337" returned: 0 in 0.816s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:50 devstack cinder-volume[92129]: DEBUG cinder.utils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Path /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-08f88a26-b850-4434-8505-824ee553ab6e not found in is_blk_device check {{(pid=92129) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:20:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-08f88a26-b850-4434-8505-824ee553ab6e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:50 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-08f88a26-b850-4434-8505-824ee553ab6e Jun 15 07:20:50 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:51 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e" returned: 0 in 0.837s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:51 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e Jun 15 07:20:51 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:52 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e" returned: 0 in 1.231s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "cinder-quobyte-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e" released by "delete_volume" :: held 2.147s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:52 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] Created reservations ['5713ca06-ff4a-4be0-9e4e-d82ea094599a', '5126eb86-dbd0-4065-874b-9655597bfca2', '792900af-6acb-4b35-afbe-afed1756b6b5', '32c2cb43-5bee-40f5-b649-8f1699898918'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:20:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:52 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:20:52 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:53 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:20:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Flow 'volume_create_manager' (cbd6e449-d036-4ca5-bf80-cbdeab4244ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:20:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b75202e-a9de-4284-b62f-63704ca0e9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b75202e-a9de-4284-b62f-63704ca0e9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2087882707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ab4ee6-ead2-419c-a59f-dcdc357d0d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f094739d164428b6659554c040d321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:53Z,use_quota=True,user_id='bcb96bb86fa942b0b6dd2bc3c645332f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d274b06-64dd-4f6e-b453-bb898e84b718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d274b06-64dd-4f6e-b453-bb898e84b718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c20ea3-826a-4e84-8db2-75d333601064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c20ea3-826a-4e84-8db2-75d333601064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ab4ee6-ead2-419c-a59f-dcdc357d0d7f', 'volume_name': 'volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8990a660-72bd-484a-bb0d-2fcb51c493ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8990a660-72bd-484a-bb0d-2fcb51c493ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24377366-02e7-4985-9039-ac33b5e0bd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:53 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Volume 97ab4ee6-ead2-419c-a59f-dcdc357d0d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f', 'volume_size': 1} Jun 15 07:20:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:54 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.645s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:54 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:20:54 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] Deleted volume successfully. Jun 15 07:20:54 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a278c7c2-40c2-499d-95f3-5b4a9cf100cd tempest-AttachVolumeShelveTestJSON-831138000 None] Lock "cinder-f346d78f-eb5b-4160-8ba3-8f4d6a5f4e7e-delete_volume" released by "delete_volume" :: held 4.313s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:56 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-08f88a26-b850-4434-8505-824ee553ab6e" returned: 0 in 5.545s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:56 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa5866d-8456-4f85-9717-0d6ab4e6588b]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:56 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 Jun 15 07:20:56 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:57 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337" returned: 0 in 0.950s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:57 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Image conversion details: src /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-08f88a26-b850-4434-8505-824ee553ab6e {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:20:57 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Converted 1024.00 MB image at 184.64 MB/s Jun 15 07:20:57 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-08f88a26-b850-4434-8505-824ee553ab6e is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:20:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-08f88a26-b850-4434-8505-824ee553ab6e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:57 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-08f88a26-b850-4434-8505-824ee553ab6e Jun 15 07:20:57 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:57 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-08f88a26-b850-4434-8505-824ee553ab6e" returned: 0 in 0.645s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:57 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Lock "cinder-quobyte-08f88a26-b850-4434-8505-824ee553ab6e" released by "_copy_volume_from_snapshot" :: held 8.928s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:57 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Acquiring lock "cinder-quobyte-c626863a-613c-4891-bbc1-e71323833d25" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:57 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Lock "cinder-quobyte-c626863a-613c-4891-bbc1-e71323833d25" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Deleting offline snapshot c626863a-613c-4891-bbc1-e71323833d25 of volume c51a4e0f-e046-4e8d-afc2-f095d819a337 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:20:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] snapshot_file for this snap is: volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:20:57 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e081bb8b-16f3-4867-a5f2-e716b24e94eb]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:58 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25 Jun 15 07:20:58 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:58 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25" returned: 0 in 0.764s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c51a4e0f-e046-4e8d-afc2-f095d819a337(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:20:58 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[878359e0-b5a7-41d8-afaa-f181ddfa1549]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:58 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 Jun 15 07:20:58 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:59 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337" returned: 0 in 0.791s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:59 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25 Jun 15 07:20:59 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:00 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25" returned: 0 in 0.739s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:00 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25 Jun 15 07:21:00 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:00 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337.c626863a-613c-4891-bbc1-e71323833d25" returned: 0 in 0.602s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Lock "cinder-quobyte-c626863a-613c-4891-bbc1-e71323833d25" released by "_delete_snapshot" :: held 3.005s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.697s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.923s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] Creating offline snapshot 01a73b76-5fe0-40d5-a980-117964d147ec of volume 10a7c633-7951-4683-8c9f-df2313467769 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:21:00 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6847cc67-19b7-4dbd-b4e5-03f5f840a539]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:01 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-40248ba4-e142-4fa7-9bf3-5c60fda127f8 tempest-GroupsV314Test-778022445 None] Create group from source-group-763aa8c9-cd06-497d-a26e-b243682c4113 completed successfully. Jun 15 07:21:01 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 Jun 15 07:21:01 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:01 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] Acquiring lock "cinder-quobyte-08f88a26-b850-4434-8505-824ee553ab6e" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:01 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:01 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] Lock "cinder-quobyte-08f88a26-b850-4434-8505-824ee553ab6e" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769" returned: 0 in 0.876s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:01 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[903253d7-aa8e-467b-b4c4-11817a472150]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-08f88a26-b850-4434-8505-824ee553ab6e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:01 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec 1G Jun 15 07:21:01 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:01 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-08f88a26-b850-4434-8505-824ee553ab6e Jun 15 07:21:01 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:02 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec 1G" returned: 0 in 0.844s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a7c633-7951-4683-8c9f-df2313467769 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:02 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-08f88a26-b850-4434-8505-824ee553ab6e" returned: 0 in 0.841s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-08f88a26-b850-4434-8505-824ee553ab6e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:02 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a7c633-7951-4683-8c9f-df2313467769 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec Jun 15 07:21:02 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:02 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-08f88a26-b850-4434-8505-824ee553ab6e Jun 15 07:21:02 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:03 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-08f88a26-b850-4434-8505-824ee553ab6e" returned: 0 in 0.808s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:03 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] Lock "cinder-quobyte-08f88a26-b850-4434-8505-824ee553ab6e" released by "delete_volume" :: held 1.709s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:03 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a7c633-7951-4683-8c9f-df2313467769 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec" returned: 0 in 0.894s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:03 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:21:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:03 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] Created reservations ['8748d347-9ffc-4c31-909f-957d2bab21fe'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:21:03 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec Jun 15 07:21:03 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:03 devstack cinder-volume[92129]: WARNING cinder.quota [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1066689614 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1066689614, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:21:03 devstack cinder-volume[92129]: WARNING cinder.quota [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1066689614 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1066689614, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:21:03 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] Created reservations ['8044c033-8525-4034-8970-c9c642f53c65', '366d9379-92da-48ee-bcd4-a292b5c48581', '85123070-ddad-4fc7-aa1d-a1e67ab9f721', '2a14f2db-3a67-450d-a807-09b1b5f35cc3'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:21:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:21:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:21:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:03 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:21:03 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] Acquiring lock "cinder-quobyte-c51a4e0f-e046-4e8d-afc2-f095d819a337" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] Lock "cinder-quobyte-c51a4e0f-e046-4e8d-afc2-f095d819a337" acquired by "delete_volume" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:04 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec" returned: 0 in 0.822s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:04 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f5bb80-be45-4171-a702-3adf702b7b6b]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:04 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.info Jun 15 07:21:04 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:04 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.749s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:04 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:21:04 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-1db0c724-17ec-4c4a-b501-77f5d1daa208 tempest-GroupsV314Test-778022445 None] Delete group completed successfully. Jun 15 07:21:04 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 Jun 15 07:21:04 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:05 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.info" returned: 0 in 0.669s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:05 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.info is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:21:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:05 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.info Jun 15 07:21:05 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:05 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337" returned: 0 in 0.835s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:05 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337 Jun 15 07:21:05 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:05 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.info" returned: 0 in 0.681s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.910s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.676s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2087882707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ab4ee6-ead2-419c-a59f-dcdc357d0d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f094739d164428b6659554c040d321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:53Z,use_quota=True,user_id='bcb96bb86fa942b0b6dd2bc3c645332f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:21:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Creating volume 97ab4ee6-ead2-419c-a59f-dcdc357d0d7f {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:21:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:21:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:21:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:21:05 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:21:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:05 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f 1073741824 Jun 15 07:21:05 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:05 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:05 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-ddb3dea2-d0d2-4f4f-8fbf-2222662466e0 tempest-GroupSnapshotsTest-869728579 None] group_snapshot 1189e2e4-d773-4adc-b784-3d9acc9e5067: created successfully Jun 15 07:21:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c51a4e0f-e046-4e8d-afc2-f095d819a337" returned: 0 in 0.716s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:06 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] Lock "cinder-quobyte-c51a4e0f-e046-4e8d-afc2-f095d819a337" released by "delete_volume" :: held 1.656s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:06 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] Created reservations ['8b2c4696-7e1b-41f1-8801-578fc6beb8af'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:21:06 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] Created reservations ['d8af3a86-93c9-4d40-9b59-670a6abc6dbc', 'bd43ffd7-0bd3-4d36-b618-a1b89203ae69', '366a70fc-00e8-427f-a0d7-b98b4f065e8f', '4a2459df-0c2d-4e46-aba7-d8de7ceb3836'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:21:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:21:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:21:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:06 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:21:06 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:06 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f 1073741824" returned: 0 in 0.966s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:06 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f Jun 15 07:21:06 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:07 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.832s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:21:07 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-cad31182-942c-4123-90e9-68ca14b7f962 tempest-GroupsV314Test-778022445 None] Delete group completed successfully. Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:07 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" returned: 0 in 0.968s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.162s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "cinder-quobyte-01a73b76-5fe0-40d5-a980-117964d147ec-1c889ed8-3294-4bf5-91df-4aea1e6e406a" by "_create_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24377366-02e7-4985-9039-ac33b5e0bd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0bfad6-61d4-4fc3-9f1c-afd4ab7f7136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-01a73b76-5fe0-40d5-a980-117964d147ec-1c889ed8-3294-4bf5-91df-4aea1e6e406a" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Creating volume 1c889ed8-3294-4bf5-91df-4aea1e6e406a from snapshot 01a73b76-5fe0-40d5-a980-117964d147ec {{(pid=92129) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "cinder-quobyte-1c889ed8-3294-4bf5-91df-4aea1e6e406a" by "_copy_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:07 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Volume volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f (97ab4ee6-ead2-419c-a59f-dcdc357d0d7f): created successfully Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0bfad6-61d4-4fc3-9f1c-afd4ab7f7136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Flow 'volume_create_manager' (cbd6e449-d036-4ca5-bf80-cbdeab4244ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-1c889ed8-3294-4bf5-91df-4aea1e6e406a" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] snapshot: 01a73b76-5fe0-40d5-a980-117964d147ec, volume: 1c889ed8-3294-4bf5-91df-4aea1e6e406a, {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:21:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:21:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:21:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:08 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-58137b85-5a5b-4784-945d-e2b1e276913a tempest-SnapshotsActionsTest-1531851628 None] Created volume successfully. Jun 15 07:21:08 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86179f9-3b99-45a1-9674-1485197edc68]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:08 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec Jun 15 07:21:08 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:09 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec" returned: 0 in 1.035s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10a7c633-7951-4683-8c9f-df2313467769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:21:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:21:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Creating direct copy from snapshot {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:21:09 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f8b756-9d05-4715-92a1-3f39311d8953]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:09 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 Jun 15 07:21:09 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:09 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769" returned: 0 in 0.873s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:09 devstack cinder-volume[92129]: DEBUG cinder.utils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Path /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1c889ed8-3294-4bf5-91df-4aea1e6e406a not found in is_blk_device check {{(pid=92129) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:21:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1c889ed8-3294-4bf5-91df-4aea1e6e406a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:10 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1c889ed8-3294-4bf5-91df-4aea1e6e406a Jun 15 07:21:10 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:21:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:21:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:21:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:14 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:21:14 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:15 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.912s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:15 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:21:15 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:21:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 8 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:21:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:21:16 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1c889ed8-3294-4bf5-91df-4aea1e6e406a" returned: 0 in 6.202s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:16 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4706a695-3dd0-40a9-9312-bd93c678e215]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:16 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 Jun 15 07:21:16 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:17 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769" returned: 0 in 1.024s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:17 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Image conversion details: src /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1c889ed8-3294-4bf5-91df-4aea1e6e406a {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:21:17 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Converted 1024.00 MB image at 165.04 MB/s Jun 15 07:21:17 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1c889ed8-3294-4bf5-91df-4aea1e6e406a is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:21:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1c889ed8-3294-4bf5-91df-4aea1e6e406a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:17 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1c889ed8-3294-4bf5-91df-4aea1e6e406a Jun 15 07:21:17 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:17 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1c889ed8-3294-4bf5-91df-4aea1e6e406a" returned: 0 in 0.717s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-1c889ed8-3294-4bf5-91df-4aea1e6e406a" released by "_copy_volume_from_snapshot" :: held 9.995s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-01a73b76-5fe0-40d5-a980-117964d147ec-1c889ed8-3294-4bf5-91df-4aea1e6e406a" released by "_create_volume_from_snapshot" :: held 10.075s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.124s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.351s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:17 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=107,cinder:INSERT=30,cinder:UPDATE=122,cinder:DELETE=6 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:21:17 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=112,cinder:INSERT=25,cinder:UPDATE=128,cinder:DELETE=5 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:21:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] Creating offline snapshot d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 of volume 97ab4ee6-ead2-419c-a59f-dcdc357d0d7f {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:21:18 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3d5f30-42f2-49da-b788-f6531269f1b2]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:18 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-cf699ee9-cff1-4611-8faa-e42c12d865d1 tempest-GroupSnapshotsTest-869728579 None] Create group from source-snapshot-1189e2e4-d773-4adc-b784-3d9acc9e5067 completed successfully. Jun 15 07:21:18 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f Jun 15 07:21:18 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:18 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" returned: 0 in 0.833s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:18 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 1G Jun 15 07:21:18 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:18 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "cinder-quobyte-1c889ed8-3294-4bf5-91df-4aea1e6e406a" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-1c889ed8-3294-4bf5-91df-4aea1e6e406a" acquired by "delete_volume" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:19 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d28b807-24e7-44af-aa88-bb1fe621329f]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1c889ed8-3294-4bf5-91df-4aea1e6e406a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:19 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1c889ed8-3294-4bf5-91df-4aea1e6e406a Jun 15 07:21:19 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:19 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:19 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1c889ed8-3294-4bf5-91df-4aea1e6e406a" returned: 0 in 0.827s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1c889ed8-3294-4bf5-91df-4aea1e6e406a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 1G" returned: 0 in 1.029s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:19 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1c889ed8-3294-4bf5-91df-4aea1e6e406a Jun 15 07:21:19 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:19 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 Jun 15 07:21:19 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:20 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1c889ed8-3294-4bf5-91df-4aea1e6e406a" returned: 0 in 0.876s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-1c889ed8-3294-4bf5-91df-4aea1e6e406a" released by "delete_volume" :: held 1.780s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:20 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2" returned: 0 in 0.935s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:20 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 is being set with open permissions: ugo+rw Jun 15 07:21:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:20 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 Jun 15 07:21:20 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:20 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] Created reservations ['aeb60276-0184-4b72-803f-24b29056e783'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:21:20 devstack cinder-volume[92129]: WARNING cinder.quota [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1498809174 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1498809174, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:21:20 devstack cinder-volume[92129]: WARNING cinder.quota [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1498809174 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1498809174, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:21:20 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] Created reservations ['b903fd9e-85ed-4626-87e6-bb55cdd7ff69', '45edb7a2-d2eb-400c-b62b-9e6831d15e61', '0b0cd33a-3dd1-48e4-956b-ce5eafd602b7', 'd66c295b-5c0e-4c29-b348-9ec821be8ccd'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:21 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:21:21 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:21 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] group_snapshot 1189e2e4-d773-4adc-b784-3d9acc9e5067: deleting Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] group_snapshot 1189e2e4-d773-4adc-b784-3d9acc9e5067: deleting {{(pid=92129) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "cinder-quobyte-10a7c633-7951-4683-8c9f-df2313467769" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-10a7c633-7951-4683-8c9f-df2313467769" acquired by "delete_snapshot" :: waited 0.035s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "cinder-quobyte-01a73b76-5fe0-40d5-a980-117964d147ec" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-01a73b76-5fe0-40d5-a980-117964d147ec" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] Deleting offline snapshot 01a73b76-5fe0-40d5-a980-117964d147ec of volume 10a7c633-7951-4683-8c9f-df2313467769 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:21:21 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] snapshot_file for this snap is: volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2" returned: 0 in 0.834s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb685b71-10ee-4f98-a1ca-7683296c53da]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:21 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.info Jun 15 07:21:21 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:21 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec Jun 15 07:21:21 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:21 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.850s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:21 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:21:21 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-46e3c837-2df7-4941-8d86-7ca3ec7d6ede tempest-GroupSnapshotsTest-869728579 None] Delete group completed successfully. Jun 15 07:21:22 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.info" returned: 0 in 0.752s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:22 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.info is being set with open permissions: ugo+rw Jun 15 07:21:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:22 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.info Jun 15 07:21:22 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:22 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec" returned: 0 in 0.859s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:22 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10a7c633-7951-4683-8c9f-df2313467769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:21:22 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc91af6-4104-4f0e-ab66-61d97892ace6]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:22 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 Jun 15 07:21:22 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:23 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.info" returned: 0 in 0.717s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.225s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:23 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-2586bf33-6d21-462c-b110-4af6b86f64b3 tempest-SnapshotsActionsTest-1531851628 None] Create snapshot completed successfully Jun 15 07:21:23 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769" returned: 0 in 0.817s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:23 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec Jun 15 07:21:23 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:24 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec" returned: 0 in 0.826s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:24 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec Jun 15 07:21:24 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9b1c1304-57ea-4509-95f8-9ad0a6c08688 tempest-SnapshotsActionsTest-1531851628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9b1c1304-57ea-4509-95f8-9ad0a6c08688 tempest-SnapshotsActionsTest-1531851628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-9b1c1304-57ea-4509-95f8-9ad0a6c08688 tempest-SnapshotsActionsTest-1531851628 None] Creating offline snapshot 26a20d07-a56d-4742-a9e6-8b03f944daf0 of volume 97ab4ee6-ead2-419c-a59f-dcdc357d0d7f {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:21:24 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc185fab-8128-4fa3-92f8-49ceaf4d7555]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9b1c1304-57ea-4509-95f8-9ad0a6c08688 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:24 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 Jun 15 07:21:24 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:24 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769.01a73b76-5fe0-40d5-a980-117964d147ec" returned: 0 in 0.745s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:25 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-01a73b76-5fe0-40d5-a980-117964d147ec" released by "_delete_snapshot" :: held 3.388s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:25 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-10a7c633-7951-4683-8c9f-df2313467769" released by "delete_snapshot" :: held 3.424s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:25 devstack cinder-volume[92129]: WARNING cinder.quota [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1498809174 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1498809174, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:21:25 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] Created reservations ['c19574da-6512-49ed-9fbb-f63525bc0493', '86ab1b6c-ff5c-48c7-979f-1a12f728f57d', '7340232f-c97c-4e4d-8695-a1accd3e58d4', '1fe2f701-f913-40a8-b3d9-a54847029c5a'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:21:25 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-7446cfba-6996-4351-b3e4-e4dbfdf005ca tempest-GroupSnapshotsTest-869728579 None] group_snapshot 1189e2e4-d773-4adc-b784-3d9acc9e5067: deleted successfully Jun 15 07:21:25 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9b1c1304-57ea-4509-95f8-9ad0a6c08688 tempest-SnapshotsActionsTest-1531851628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2" returned: 0 in 0.948s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-9b1c1304-57ea-4509-95f8-9ad0a6c08688 tempest-SnapshotsActionsTest-1531851628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:21:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9b1c1304-57ea-4509-95f8-9ad0a6c08688 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:25 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0 1G Jun 15 07:21:25 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "cinder-quobyte-10a7c633-7951-4683-8c9f-df2313467769" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-10a7c633-7951-4683-8c9f-df2313467769" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:26 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[19037981-87de-4fc3-8415-4350586c7fe1]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:26 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 Jun 15 07:21:26 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:26 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9b1c1304-57ea-4509-95f8-9ad0a6c08688 tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0 1G" returned: 0 in 1.188s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9b1c1304-57ea-4509-95f8-9ad0a6c08688 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:26 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0 Jun 15 07:21:26 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:27 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769" returned: 0 in 1.113s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:27 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9b1c1304-57ea-4509-95f8-9ad0a6c08688 tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0" returned: 0 in 0.839s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:27 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-9b1c1304-57ea-4509-95f8-9ad0a6c08688 tempest-SnapshotsActionsTest-1531851628 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0 is being set with open permissions: ugo+rw Jun 15 07:21:27 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769 Jun 15 07:21:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9b1c1304-57ea-4509-95f8-9ad0a6c08688 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:27 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:27 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0 Jun 15 07:21:27 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:28 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10a7c633-7951-4683-8c9f-df2313467769" returned: 0 in 0.617s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-10a7c633-7951-4683-8c9f-df2313467769" released by "delete_volume" :: held 1.822s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:28 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9b1c1304-57ea-4509-95f8-9ad0a6c08688 tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0" returned: 0 in 0.643s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9b1c1304-57ea-4509-95f8-9ad0a6c08688 tempest-SnapshotsActionsTest-1531851628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.727s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:28 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-9b1c1304-57ea-4509-95f8-9ad0a6c08688 tempest-SnapshotsActionsTest-1531851628 None] Create snapshot completed successfully Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] Created reservations ['80e1c987-155f-4571-b038-15bfe3426b3f'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:21:28 devstack cinder-volume[92129]: WARNING cinder.db.sqlalchemy.api [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1498809174'] Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] Created reservations ['1e1638b4-03ea-495f-8a72-0077c4139b09', 'fa8cc2a9-3e8f-4f87-a9f7-8fe1b5bb4f96', 'aae21ea1-855a-4081-bbcb-6fda8d57f6ec', 'de2922b0-edb9-4241-926b-3b34c79e85d2'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:28 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:21:28 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Acquiring lock "cinder-26a20d07-a56d-4742-a9e6-8b03f944daf0-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-26a20d07-a56d-4742-a9e6-8b03f944daf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Acquiring lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Acquiring lock "cinder-quobyte-26a20d07-a56d-4742-a9e6-8b03f944daf0" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-quobyte-26a20d07-a56d-4742-a9e6-8b03f944daf0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Deleting offline snapshot 26a20d07-a56d-4742-a9e6-8b03f944daf0 of volume 97ab4ee6-ead2-419c-a59f-dcdc357d0d7f {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:21:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] snapshot_file for this snap is: volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:21:29 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[98063bc5-b091-4442-888c-ea2c2a5cc3bb]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:29 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0f59a1ef-354b-4d1b-963e-2efa0706d8d8 tempest-GroupSnapshotsTest-869728579 None] Group tempest-GroupSnapshotsTest-Group-1303693788: creating Jun 15 07:21:29 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0 Jun 15 07:21:29 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:29 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0f59a1ef-354b-4d1b-963e-2efa0706d8d8 tempest-GroupSnapshotsTest-869728579 None] Group tempest-GroupSnapshotsTest-Group-1303693788: created successfully Jun 15 07:21:29 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0f59a1ef-354b-4d1b-963e-2efa0706d8d8 tempest-GroupSnapshotsTest-869728579 None] Create group completed successfully. Jun 15 07:21:29 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.828s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:29 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:21:29 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-37b907b6-bbd3-4b04-b63e-a6d931ee3ab5 tempest-GroupSnapshotsTest-869728579 None] Delete group completed successfully. Jun 15 07:21:29 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0" returned: 0 in 0.794s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:21:29 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7263794f-23f0-4c4b-b325-41d0e08d92b5]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:29 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 Jun 15 07:21:29 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:30 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2" returned: 0 in 0.794s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:21:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:30 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0 Jun 15 07:21:30 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:30 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Flow 'volume_create_manager' (8d108138-40a3-4dd7-b5b4-bf2d6b89cedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f355ea-24f1-4c4d-a738-c93e7c48e55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f355ea-24f1-4c4d-a738-c93e7c48e55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1678426985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f4c37a0-97d2-4946-bfbb-5c48aacd8e81,host='devstack@QuobyteHD#QuobyteHD',id=9a01a825-adc8-4584-9836-b2dec44eb322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507aaf4064d14210ae90520f1875db68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:21:31Z,use_quota=True,user_id='a2cde9e162384edbaf95a66df9db0916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1dd741e-0e51-4587-927a-b76652aaeda5),volume_type_id=a1dd741e-0e51-4587-927a-b76652aaeda5)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a227a2ca-9279-4f2d-abf3-33177288a42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a227a2ca-9279-4f2d-abf3-33177288a42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd780a01-51ea-40f2-95f2-505bbd8edee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd780a01-51ea-40f2-95f2-505bbd8edee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a01a825-adc8-4584-9836-b2dec44eb322', 'volume_name': 'volume-9a01a825-adc8-4584-9836-b2dec44eb322', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff5b5f1-1531-429a-a159-bd1e1b752128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff5b5f1-1531-429a-a159-bd1e1b752128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3b1473-9f86-41e6-8e5f-0f2753d24e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:31 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Volume 9a01a825-adc8-4584-9836-b2dec44eb322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a01a825-adc8-4584-9836-b2dec44eb322', 'volume_size': 1} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4f4c37a0-97d2-4946-bfbb-5c48aacd8e81,created_at=2026-06-15T05:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1678426985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f4c37a0-97d2-4946-bfbb-5c48aacd8e81,host='devstack@QuobyteHD#QuobyteHD',id=9a01a825-adc8-4584-9836-b2dec44eb322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507aaf4064d14210ae90520f1875db68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:21:31Z,use_quota=True,user_id='a2cde9e162384edbaf95a66df9db0916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1dd741e-0e51-4587-927a-b76652aaeda5),volume_type_id=a1dd741e-0e51-4587-927a-b76652aaeda5)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Creating volume 9a01a825-adc8-4584-9836-b2dec44eb322 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:21:31 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:31 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322 1073741824 Jun 15 07:21:31 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:31 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0" returned: 0 in 0.894s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:31 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0 Jun 15 07:21:31 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:31 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322 1073741824" returned: 0 in 0.897s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:32 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322 Jun 15 07:21:32 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:32 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.26a20d07-a56d-4742-a9e6-8b03f944daf0" returned: 0 in 0.714s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-quobyte-26a20d07-a56d-4742-a9e6-8b03f944daf0" released by "_delete_snapshot" :: held 3.324s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" released by "delete_snapshot" :: held 3.353s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:32 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Created reservations ['8b061870-b42e-4aa2-9167-d1906e8f6e4c', '1814484a-e441-4fe4-9e8e-f2553c472080', '2095ea63-84a9-451c-bfaa-ae9dead1a87a', '2036a148-0322-439c-80fd-cb96a9418434'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:21:32 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Delete snapshot completed successfully. Jun 15 07:21:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bc591f34-a8e6-433b-94dd-9c5f33a9e2f6 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-26a20d07-a56d-4742-a9e6-8b03f944daf0-delete_snapshot" released by "delete_snapshot" :: held 3.548s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:33 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322" returned: 0 in 0.981s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:21:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3b1473-9f86-41e6-8e5f-0f2753d24e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a01a825-adc8-4584-9836-b2dec44eb322', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d43836d-9fc2-46a0-9e36-40dfca8ec0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:33 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Volume volume-9a01a825-adc8-4584-9836-b2dec44eb322 (9a01a825-adc8-4584-9836-b2dec44eb322): created successfully Jun 15 07:21:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d43836d-9fc2-46a0-9e36-40dfca8ec0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Flow 'volume_create_manager' (8d108138-40a3-4dd7-b5b4-bf2d6b89cedc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:21:33 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-ed4d249d-5fec-4e2c-bbe0-dc31dd205d67 tempest-GroupSnapshotsTest-869728579 None] Created volume successfully. Jun 15 07:21:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-51092753-f91f-4ae5-8e41-8f7c95619f4c tempest-SnapshotsActionsTest-1531851628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-51092753-f91f-4ae5-8e41-8f7c95619f4c tempest-SnapshotsActionsTest-1531851628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-51092753-f91f-4ae5-8e41-8f7c95619f4c tempest-SnapshotsActionsTest-1531851628 None] Creating offline snapshot 73495c7b-5df5-4461-8c2e-d7d983118b8f of volume 97ab4ee6-ead2-419c-a59f-dcdc357d0d7f {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:21:34 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[300b00bd-26b5-4f7a-b212-632bfbe4e155]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-51092753-f91f-4ae5-8e41-8f7c95619f4c tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:34 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:21:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Flow 'volume_create_manager' (1972c40a-52ce-49b2-9ab5-95de937d482e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:21:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ada2c52-91d4-47a9-b004-856e8353b63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ada2c52-91d4-47a9-b004-856e8353b63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1962424238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f4c37a0-97d2-4946-bfbb-5c48aacd8e81,host='devstack@QuobyteHD#QuobyteHD',id=f876eb92-8725-4c01-bcdf-797fa0e35c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507aaf4064d14210ae90520f1875db68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:21:34Z,use_quota=True,user_id='a2cde9e162384edbaf95a66df9db0916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1dd741e-0e51-4587-927a-b76652aaeda5),volume_type_id=a1dd741e-0e51-4587-927a-b76652aaeda5)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c462a0-ec83-4f2b-9480-5cb1a88dfab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c462a0-ec83-4f2b-9480-5cb1a88dfab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59488e07-3fbb-4063-ad5d-75cd2308ef19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59488e07-3fbb-4063-ad5d-75cd2308ef19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f876eb92-8725-4c01-bcdf-797fa0e35c19', 'volume_name': 'volume-f876eb92-8725-4c01-bcdf-797fa0e35c19', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3fb3be-750c-4376-a135-ea89582d17e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3fb3be-750c-4376-a135-ea89582d17e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f503c9b6-4ba7-4c88-b088-6d296daa237e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:34 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Volume f876eb92-8725-4c01-bcdf-797fa0e35c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f876eb92-8725-4c01-bcdf-797fa0e35c19', 'volume_size': 1} Jun 15 07:21:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:34 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 Jun 15 07:21:34 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:35 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:21:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Flow 'volume_create_manager' (a742bfa7-c6a0-4bc6-9aff-b18eb01323e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:21:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f062358-4324-40a1-a798-61d864c53c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f062358-4324-40a1-a798-61d864c53c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1391418268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd096c85-d575-40f9-a9d2-3b8e05cf5a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c6a247eb694a01bf1096cfdee4139c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:21:35Z,use_quota=True,user_id='821faa08f9854be3835c2f3af023c66d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737997f4-8b7c-4640-b3f0-859c0e045105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737997f4-8b7c-4640-b3f0-859c0e045105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de58fb9b-9768-41ae-8367-b77878b926d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:35 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de58fb9b-9768-41ae-8367-b77878b926d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd096c85-d575-40f9-a9d2-3b8e05cf5a21', 'volume_name': 'volume-bd096c85-d575-40f9-a9d2-3b8e05cf5a21', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77fce6c-1882-4512-bea1-30a01785f373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77fce6c-1882-4512-bea1-30a01785f373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a476eac7-2938-4a6f-8ca6-5f98669f0087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:35 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Volume bd096c85-d575-40f9-a9d2-3b8e05cf5a21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd096c85-d575-40f9-a9d2-3b8e05cf5a21', 'volume_size': 1} Jun 15 07:21:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-51092753-f91f-4ae5-8e41-8f7c95619f4c tempest-SnapshotsActionsTest-1531851628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2" returned: 0 in 1.063s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:35 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-51092753-f91f-4ae5-8e41-8f7c95619f4c tempest-SnapshotsActionsTest-1531851628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:21:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-51092753-f91f-4ae5-8e41-8f7c95619f4c tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:35 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f 1G Jun 15 07:21:35 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:36 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-51092753-f91f-4ae5-8e41-8f7c95619f4c tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f 1G" returned: 0 in 0.989s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-51092753-f91f-4ae5-8e41-8f7c95619f4c tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:36 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f Jun 15 07:21:36 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:37 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-51092753-f91f-4ae5-8e41-8f7c95619f4c tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f" returned: 0 in 0.759s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:37 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-51092753-f91f-4ae5-8e41-8f7c95619f4c tempest-SnapshotsActionsTest-1531851628 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f is being set with open permissions: ugo+rw Jun 15 07:21:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-51092753-f91f-4ae5-8e41-8f7c95619f4c tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:37 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f Jun 15 07:21:37 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:37 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-51092753-f91f-4ae5-8e41-8f7c95619f4c tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f" returned: 0 in 0.655s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-51092753-f91f-4ae5-8e41-8f7c95619f4c tempest-SnapshotsActionsTest-1531851628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.673s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.327s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4f4c37a0-97d2-4946-bfbb-5c48aacd8e81,created_at=2026-06-15T05:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1962424238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f4c37a0-97d2-4946-bfbb-5c48aacd8e81,host='devstack@QuobyteHD#QuobyteHD',id=f876eb92-8725-4c01-bcdf-797fa0e35c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507aaf4064d14210ae90520f1875db68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:21:34Z,use_quota=True,user_id='a2cde9e162384edbaf95a66df9db0916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1dd741e-0e51-4587-927a-b76652aaeda5),volume_type_id=a1dd741e-0e51-4587-927a-b76652aaeda5)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:21:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Creating volume f876eb92-8725-4c01-bcdf-797fa0e35c19 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:21:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:21:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:21:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:21:37 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:21:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:37 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19 1073741824 Jun 15 07:21:37 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:37 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-51092753-f91f-4ae5-8e41-8f7c95619f4c tempest-SnapshotsActionsTest-1531851628 None] Create snapshot completed successfully Jun 15 07:21:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Acquiring lock "cinder-73495c7b-5df5-4461-8c2e-d7d983118b8f-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-73495c7b-5df5-4461-8c2e-d7d983118b8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Acquiring lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Acquiring lock "cinder-quobyte-73495c7b-5df5-4461-8c2e-d7d983118b8f" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-quobyte-73495c7b-5df5-4461-8c2e-d7d983118b8f" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Deleting offline snapshot 73495c7b-5df5-4461-8c2e-d7d983118b8f of volume 97ab4ee6-ead2-419c-a59f-dcdc357d0d7f {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:21:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] snapshot_file for this snap is: volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:21:38 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[10181c81-6b25-46d8-a393-b0d772eb2286]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:38 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19 1073741824" returned: 0 in 0.967s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:38 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f Jun 15 07:21:38 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:38 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19 Jun 15 07:21:38 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:39 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19" returned: 0 in 0.615s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.110s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1391418268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd096c85-d575-40f9-a9d2-3b8e05cf5a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c6a247eb694a01bf1096cfdee4139c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:21:35Z,use_quota=True,user_id='821faa08f9854be3835c2f3af023c66d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Creating volume bd096c85-d575-40f9-a9d2-3b8e05cf5a21 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:21:39 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-bd096c85-d575-40f9-a9d2-3b8e05cf5a21 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:39 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f" returned: 0 in 0.810s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:21:39 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-bd096c85-d575-40f9-a9d2-3b8e05cf5a21 1073741824 Jun 15 07:21:39 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f503c9b6-4ba7-4c88-b088-6d296daa237e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f876eb92-8725-4c01-bcdf-797fa0e35c19', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9ed5cf-22ac-4a82-ac02-205ff7db1840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4e41d4-8caf-4a6a-b475-91b709578de9]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:39 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Volume volume-f876eb92-8725-4c01-bcdf-797fa0e35c19 (f876eb92-8725-4c01-bcdf-797fa0e35c19): created successfully Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9ed5cf-22ac-4a82-ac02-205ff7db1840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Flow 'volume_create_manager' (1972c40a-52ce-49b2-9ab5-95de937d482e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:21:39 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-73b6e355-5fe5-4697-83d8-24178c84be25 tempest-GroupSnapshotsTest-869728579 None] Created volume successfully. Jun 15 07:21:39 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 Jun 15 07:21:39 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:40 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-50be2662-7198-4a17-8dac-898e0210f27d tempest-GroupSnapshotsTest-869728579 None] Update group completed successfully. Jun 15 07:21:40 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-bd096c85-d575-40f9-a9d2-3b8e05cf5a21 1073741824" returned: 0 in 0.832s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-bd096c85-d575-40f9-a9d2-3b8e05cf5a21 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:40 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-bd096c85-d575-40f9-a9d2-3b8e05cf5a21 Jun 15 07:21:40 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:40 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2" returned: 0 in 0.850s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:21:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:40 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f Jun 15 07:21:40 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:41 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-bd096c85-d575-40f9-a9d2-3b8e05cf5a21" returned: 0 in 0.611s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:41 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:21:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a476eac7-2938-4a6f-8ca6-5f98669f0087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd096c85-d575-40f9-a9d2-3b8e05cf5a21', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d19fc77-82e5-4e6f-b687-ac9b9aa0aa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:41 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Volume volume-bd096c85-d575-40f9-a9d2-3b8e05cf5a21 (bd096c85-d575-40f9-a9d2-3b8e05cf5a21): created successfully Jun 15 07:21:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d19fc77-82e5-4e6f-b687-ac9b9aa0aa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Flow 'volume_create_manager' (a742bfa7-c6a0-4bc6-9aff-b18eb01323e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:21:41 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-df990108-69dd-47eb-80d8-7b3fefcbb382 tempest-VolumesServicesTestJSON-541727883 None] Created volume successfully. Jun 15 07:21:41 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f" returned: 0 in 0.771s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:41 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f Jun 15 07:21:41 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:41 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c582e2e9-a32d-4e26-8457-5d60e2c6571c tempest-GroupSnapshotsTest-869728579 None] Update group completed successfully. Jun 15 07:21:41 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.73495c7b-5df5-4461-8c2e-d7d983118b8f" returned: 0 in 0.630s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] Acquiring lock "cinder-bd096c85-d575-40f9-a9d2-3b8e05cf5a21-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-quobyte-73495c7b-5df5-4461-8c2e-d7d983118b8f" released by "_delete_snapshot" :: held 3.205s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" released by "delete_snapshot" :: held 3.257s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] Lock "cinder-bd096c85-d575-40f9-a9d2-3b8e05cf5a21-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] Acquiring lock "cinder-quobyte-bd096c85-d575-40f9-a9d2-3b8e05cf5a21" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] Lock "cinder-quobyte-bd096c85-d575-40f9-a9d2-3b8e05cf5a21" acquired by "delete_volume" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:42 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5fe590-d830-4f4d-b9f6-0b9f05cbbbf4]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-bd096c85-d575-40f9-a9d2-3b8e05cf5a21 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:42 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Created reservations ['92a13b89-8e97-4ea0-9506-754427d41c7f', 'c86e860e-e355-4a24-b7ee-8805c9d8c608', '82a83079-b688-4613-8c0d-6719d4ef4f78', '37ba7a7b-7ffb-49c2-9426-8bd939befeb4'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:21:42 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Delete snapshot completed successfully. Jun 15 07:21:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8d91ca17-c8d4-47cd-8ac2-caf4b931398b tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-73495c7b-5df5-4461-8c2e-d7d983118b8f-delete_snapshot" released by "delete_snapshot" :: held 3.515s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:42 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-bd096c85-d575-40f9-a9d2-3b8e05cf5a21 Jun 15 07:21:42 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:42 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-8834e0b8-4831-439c-873d-c644c0e7e665 tempest-GroupSnapshotsTest-869728579 None] Update group completed successfully. Jun 15 07:21:42 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-bd096c85-d575-40f9-a9d2-3b8e05cf5a21" returned: 0 in 0.747s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-bd096c85-d575-40f9-a9d2-3b8e05cf5a21 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:42 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-bd096c85-d575-40f9-a9d2-3b8e05cf5a21 Jun 15 07:21:42 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e60c0a8a-99ae-46f6-b3bd-f6e357851215 tempest-SnapshotsActionsTest-1531851628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e60c0a8a-99ae-46f6-b3bd-f6e357851215 tempest-SnapshotsActionsTest-1531851628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-e60c0a8a-99ae-46f6-b3bd-f6e357851215 tempest-SnapshotsActionsTest-1531851628 None] Creating offline snapshot a21023b1-881f-47be-8eaf-87f7a353fbdd of volume 97ab4ee6-ead2-419c-a59f-dcdc357d0d7f {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:21:43 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a00b5c-2225-4d00-a9cb-f604ce7bc3b5]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e60c0a8a-99ae-46f6-b3bd-f6e357851215 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:43 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-bd096c85-d575-40f9-a9d2-3b8e05cf5a21" returned: 0 in 0.606s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:43 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 Jun 15 07:21:43 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] Lock "cinder-quobyte-bd096c85-d575-40f9-a9d2-3b8e05cf5a21" released by "delete_volume" :: held 1.402s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:43 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] Created reservations ['4fb1afb1-fb43-4fe2-9fdb-1b2c5e4d6f8b', '85f22287-f28f-4c0d-a7c1-58b1e01905bb', '9cdd9fc2-1640-448e-a73e-5801141f1b33', 'd96fa010-e3c2-4032-94f4-ea0f4137ffd3'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:21:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:21:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:21:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:43 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:21:43 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:43 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-cc0bcf5c-44fd-4d83-860b-88f2b153b887 tempest-GroupSnapshotsTest-869728579 None] Update group completed successfully. Jun 15 07:21:44 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e60c0a8a-99ae-46f6-b3bd-f6e357851215 tempest-SnapshotsActionsTest-1531851628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2" returned: 0 in 0.795s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:44 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-e60c0a8a-99ae-46f6-b3bd-f6e357851215 tempest-SnapshotsActionsTest-1531851628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:21:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e60c0a8a-99ae-46f6-b3bd-f6e357851215 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:44 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd 1G Jun 15 07:21:44 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:44 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.837s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:44 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:21:44 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] Deleted volume successfully. Jun 15 07:21:44 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-26ffb815-aab9-48c9-9455-f18851cfed86 tempest-VolumesServicesTestJSON-541727883 None] Lock "cinder-bd096c85-d575-40f9-a9d2-3b8e05cf5a21-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:45 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e60c0a8a-99ae-46f6-b3bd-f6e357851215 tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd 1G" returned: 0 in 1.100s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e60c0a8a-99ae-46f6-b3bd-f6e357851215 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:45 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd Jun 15 07:21:45 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:45 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] GroupSnapshot db7502dd-cfbe-43c3-8f9f-51722648a675: creating. Jun 15 07:21:45 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Group snapshot db7502dd-cfbe-43c3-8f9f-51722648a675: creating. {{(pid=92129) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 15 07:21:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:46 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e60c0a8a-99ae-46f6-b3bd-f6e357851215 tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd" returned: 0 in 0.816s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:46 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-e60c0a8a-99ae-46f6-b3bd-f6e357851215 tempest-SnapshotsActionsTest-1531851628 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd is being set with open permissions: ugo+rw Jun 15 07:21:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e60c0a8a-99ae-46f6-b3bd-f6e357851215 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:46 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd Jun 15 07:21:46 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:46 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e60c0a8a-99ae-46f6-b3bd-f6e357851215 tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd" returned: 0 in 0.659s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e60c0a8a-99ae-46f6-b3bd-f6e357851215 tempest-SnapshotsActionsTest-1531851628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.467s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.234s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:46 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Creating offline snapshot 7f4a012a-cb50-44a9-b746-db846e159ef2 of volume 9a01a825-adc8-4584-9836-b2dec44eb322 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:21:46 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-e60c0a8a-99ae-46f6-b3bd-f6e357851215 tempest-SnapshotsActionsTest-1531851628 None] Create snapshot completed successfully Jun 15 07:21:46 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1068ef5f-689e-43a9-aac0-39b0d84a2b07]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:46 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322 Jun 15 07:21:46 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Acquiring lock "cinder-a21023b1-881f-47be-8eaf-87f7a353fbdd-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:47 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-a21023b1-881f-47be-8eaf-87f7a353fbdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Acquiring lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322" returned: 0 in 0.861s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" acquired by "delete_snapshot" :: waited 0.034s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Acquiring lock "cinder-quobyte-a21023b1-881f-47be-8eaf-87f7a353fbdd" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:47 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2 1G Jun 15 07:21:47 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-quobyte-a21023b1-881f-47be-8eaf-87f7a353fbdd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:47 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Deleting offline snapshot a21023b1-881f-47be-8eaf-87f7a353fbdd of volume 97ab4ee6-ead2-419c-a59f-dcdc357d0d7f {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:21:47 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] snapshot_file for this snap is: volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:21:47 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[417f94c9-f332-4462-b188-5ab0ed9e21de]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:47 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd Jun 15 07:21:47 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:48 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2 1G" returned: 0 in 0.841s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a01a825-adc8-4584-9836-b2dec44eb322 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:48 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a01a825-adc8-4584-9836-b2dec44eb322 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2 Jun 15 07:21:48 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:48 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd" returned: 0 in 0.860s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:21:48 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8e19fb-1680-4068-a4e3-699efb19f3e4]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:48 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 Jun 15 07:21:48 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:49 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a01a825-adc8-4584-9836-b2dec44eb322 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2" returned: 0 in 0.813s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:49 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2 is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:21:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:49 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2 Jun 15 07:21:49 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:49 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2" returned: 0 in 0.862s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:21:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:49 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd Jun 15 07:21:49 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:50 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2" returned: 0 in 0.692s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:50 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.info Jun 15 07:21:50 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:50 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd" returned: 0 in 0.920s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:50 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd Jun 15 07:21:50 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:50 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.info" returned: 0 in 0.686s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:50 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.info is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:21:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:50 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.info Jun 15 07:21:50 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:51 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.a21023b1-881f-47be-8eaf-87f7a353fbdd" returned: 0 in 0.691s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-quobyte-a21023b1-881f-47be-8eaf-87f7a353fbdd" released by "_delete_snapshot" :: held 3.486s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" released by "delete_snapshot" :: held 3.514s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:51 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Created reservations ['f280d9b8-0b6e-4f54-9654-d63d0f54ff6d', 'd93b981b-a58d-4882-b62e-7e63a0f41ef2', 'c1c4564d-dbcd-45c4-a100-c1fc10ed68a4', '23924df2-b67c-4603-907a-5f69ead84586'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:21:51 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Delete snapshot completed successfully. Jun 15 07:21:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0bb4e043-cd51-4537-a68c-9140e7336885 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-a21023b1-881f-47be-8eaf-87f7a353fbdd-delete_snapshot" released by "delete_snapshot" :: held 3.709s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:51 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.info" returned: 0 in 0.699s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.719s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:51 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Creating offline snapshot d9e287eb-a2fb-432a-ba53-f4242b212d32 of volume f876eb92-8725-4c01-bcdf-797fa0e35c19 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:21:51 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31f1c85-b20e-45f7-92cc-e15ec4c7e508]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:51 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19 Jun 15 07:21:51 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:52 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19" returned: 0 in 0.778s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:52 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32 1G Jun 15 07:21:52 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-312d0010-7cf2-470a-93c8-ab2df80a70ca tempest-SnapshotsActionsTest-1531851628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:53 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32 1G" returned: 0 in 0.850s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f876eb92-8725-4c01-bcdf-797fa0e35c19 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:53 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f876eb92-8725-4c01-bcdf-797fa0e35c19 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32 Jun 15 07:21:53 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:53 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f876eb92-8725-4c01-bcdf-797fa0e35c19 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32" returned: 0 in 0.744s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:53 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32 is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:21:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:53 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32 Jun 15 07:21:53 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:54 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32" returned: 0 in 0.636s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:54 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.info Jun 15 07:21:54 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:55 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.info" returned: 0 in 0.741s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:55 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.info is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:21:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:55 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.info Jun 15 07:21:55 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:55 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.info" returned: 0 in 0.660s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.540s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-312d0010-7cf2-470a-93c8-ab2df80a70ca tempest-SnapshotsActionsTest-1531851628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.675s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:56 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-312d0010-7cf2-470a-93c8-ab2df80a70ca tempest-SnapshotsActionsTest-1531851628 None] Creating offline snapshot afecb067-5cf0-41c2-9eb2-18eaee428f50 of volume 97ab4ee6-ead2-419c-a59f-dcdc357d0d7f {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:21:56 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d81b26-a892-4998-a27f-87509a79f07c]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-312d0010-7cf2-470a-93c8-ab2df80a70ca tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:56 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-4a294e09-3861-4400-b32c-5c515ba18b11 tempest-GroupSnapshotsTest-869728579 None] group_snapshot db7502dd-cfbe-43c3-8f9f-51722648a675: created successfully Jun 15 07:21:56 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 Jun 15 07:21:56 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:56 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-312d0010-7cf2-470a-93c8-ab2df80a70ca tempest-SnapshotsActionsTest-1531851628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2" returned: 0 in 0.781s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:56 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-312d0010-7cf2-470a-93c8-ab2df80a70ca tempest-SnapshotsActionsTest-1531851628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:21:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-312d0010-7cf2-470a-93c8-ab2df80a70ca tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:56 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50 1G Jun 15 07:21:56 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:57 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] group_snapshot db7502dd-cfbe-43c3-8f9f-51722648a675: deleting Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] group_snapshot db7502dd-cfbe-43c3-8f9f-51722648a675: deleting {{(pid=92129) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "cinder-quobyte-9a01a825-adc8-4584-9836-b2dec44eb322" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-9a01a825-adc8-4584-9836-b2dec44eb322" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "cinder-quobyte-7f4a012a-cb50-44a9-b746-db846e159ef2" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-7f4a012a-cb50-44a9-b746-db846e159ef2" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Deleting offline snapshot 7f4a012a-cb50-44a9-b746-db846e159ef2 of volume 9a01a825-adc8-4584-9836-b2dec44eb322 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] snapshot_file for this snap is: volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ea164e-9636-44a3-8562-017fc68d2136]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:57 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2 Jun 15 07:21:57 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Flow 'volume_create_manager' (85d0f550-c545-4f45-b3b8-c153a3bdbeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c8f0e5-ee4d-4161-9070-061ad4e5699c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c8f0e5-ee4d-4161-9070-061ad4e5699c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-826896748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e75b0b7-df8b-4e7e-b40e-2eea0e20241d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf9e1ad451034849a3a040b9f7d8063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:21:58Z,use_quota=True,user_id='5e3b2bce93c648f1a501081504459edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4725cdb8-79f9-4441-8147-9b8e311b89e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4725cdb8-79f9-4441-8147-9b8e311b89e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087b091f-321b-48e0-a14b-a9bbf492afe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087b091f-321b-48e0-a14b-a9bbf492afe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e75b0b7-df8b-4e7e-b40e-2eea0e20241d', 'volume_name': 'volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7e667d-ebc3-4228-938a-be180c25255b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7e667d-ebc3-4228-938a-be180c25255b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce140ea-17f1-47d2-9721-f185581bdaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:57 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Volume 5e75b0b7-df8b-4e7e-b40e-2eea0e20241d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d', 'volume_size': 1} Jun 15 07:21:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:58 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-312d0010-7cf2-470a-93c8-ab2df80a70ca tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50 1G" returned: 0 in 1.206s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-312d0010-7cf2-470a-93c8-ab2df80a70ca tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:58 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50 Jun 15 07:21:58 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:58 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2" returned: 0 in 0.870s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a01a825-adc8-4584-9836-b2dec44eb322(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:21:58 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5febe2-fb13-4e19-8f47-02b1fb87127e]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:58 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322 Jun 15 07:21:58 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:58 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-312d0010-7cf2-470a-93c8-ab2df80a70ca tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50" returned: 0 in 0.686s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:58 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-312d0010-7cf2-470a-93c8-ab2df80a70ca tempest-SnapshotsActionsTest-1531851628 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50 is being set with open permissions: ugo+rw Jun 15 07:21:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-312d0010-7cf2-470a-93c8-ab2df80a70ca tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:58 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50 Jun 15 07:21:58 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:59 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322" returned: 0 in 0.902s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:59 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2 Jun 15 07:21:59 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:59 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-312d0010-7cf2-470a-93c8-ab2df80a70ca tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50" returned: 0 in 0.744s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-312d0010-7cf2-470a-93c8-ab2df80a70ca tempest-SnapshotsActionsTest-1531851628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.522s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.706s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-826896748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e75b0b7-df8b-4e7e-b40e-2eea0e20241d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf9e1ad451034849a3a040b9f7d8063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:21:58Z,use_quota=True,user_id='5e3b2bce93c648f1a501081504459edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Creating volume 5e75b0b7-df8b-4e7e-b40e-2eea0e20241d {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:21:59 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:59 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d 1073741824 Jun 15 07:21:59 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:59 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-312d0010-7cf2-470a-93c8-ab2df80a70ca tempest-SnapshotsActionsTest-1531851628 None] Create snapshot completed successfully Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Acquiring lock "cinder-afecb067-5cf0-41c2-9eb2-18eaee428f50-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-afecb067-5cf0-41c2-9eb2-18eaee428f50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Acquiring lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:59 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Acquiring lock "cinder-quobyte-afecb067-5cf0-41c2-9eb2-18eaee428f50" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-quobyte-afecb067-5cf0-41c2-9eb2-18eaee428f50" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Deleting offline snapshot afecb067-5cf0-41c2-9eb2-18eaee428f50 of volume 97ab4ee6-ead2-419c-a59f-dcdc357d0d7f {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:22:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] snapshot_file for this snap is: volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:22:00 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6083ce2a-97b0-40aa-8eb1-6b8f95752074]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:00 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50 Jun 15 07:22:00 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:00 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2" returned: 0 in 0.969s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:00 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2 Jun 15 07:22:00 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:00 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d 1073741824" returned: 0 in 1.015s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:00 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d Jun 15 07:22:00 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:00 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50" returned: 0 in 0.851s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:22:00 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01fd70f-9e3f-49bb-bf48-2ef77d3435f1]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:01 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322.7f4a012a-cb50-44a9-b746-db846e159ef2" returned: 0 in 0.831s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:01 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 Jun 15 07:22:01 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-7f4a012a-cb50-44a9-b746-db846e159ef2" released by "_delete_snapshot" :: held 3.707s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-9a01a825-adc8-4584-9836-b2dec44eb322" released by "delete_snapshot" :: held 3.771s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "cinder-quobyte-f876eb92-8725-4c01-bcdf-797fa0e35c19" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-f876eb92-8725-4c01-bcdf-797fa0e35c19" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "cinder-quobyte-d9e287eb-a2fb-432a-ba53-f4242b212d32" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-d9e287eb-a2fb-432a-ba53-f4242b212d32" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Deleting offline snapshot d9e287eb-a2fb-432a-ba53-f4242b212d32 of volume f876eb92-8725-4c01-bcdf-797fa0e35c19 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] snapshot_file for this snap is: volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[205a7fab-653a-4cdf-82bd-ea9fcb857665]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:01 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32 Jun 15 07:22:01 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:01 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d" returned: 0 in 0.811s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce140ea-17f1-47d2-9721-f185581bdaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff67dc50-b13c-4231-a34f-73139b380980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:01 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Volume volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d (5e75b0b7-df8b-4e7e-b40e-2eea0e20241d): created successfully Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff67dc50-b13c-4231-a34f-73139b380980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Flow 'volume_create_manager' (85d0f550-c545-4f45-b3b8-c153a3bdbeb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:22:01 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c3f9c154-a245-4b40-8c41-2c817d353460 tempest-AttachVolumeTestJSON-1407893396 None] Created volume successfully. Jun 15 07:22:01 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2" returned: 0 in 0.921s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:22:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:01 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50 Jun 15 07:22:01 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:02 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32" returned: 0 in 1.012s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f876eb92-8725-4c01-bcdf-797fa0e35c19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:22:02 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d3fe4d-0987-419d-a536-fac30f348471]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:02 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19 Jun 15 07:22:02 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:02 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50" returned: 0 in 0.921s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:02 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50 Jun 15 07:22:02 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:03 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19" returned: 0 in 0.777s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:03 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32 Jun 15 07:22:03 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:03 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.afecb067-5cf0-41c2-9eb2-18eaee428f50" returned: 0 in 0.627s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:03 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-quobyte-afecb067-5cf0-41c2-9eb2-18eaee428f50" released by "_delete_snapshot" :: held 3.460s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:03 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" released by "delete_snapshot" :: held 3.496s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:03 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Created reservations ['e652a04c-3def-467f-b567-68d48322b1eb', '34a4ffe4-a4db-4e47-8c2c-97387bb7d215', 'afc676a4-6198-4c77-89f7-5f300f2a2963', '1109e623-b2cf-491e-863a-c394f4db2bcc'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:03 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Delete snapshot completed successfully. Jun 15 07:22:03 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d7543c75-8ba0-44bc-8a91-5e503b6331f1 tempest-SnapshotsActionsTest-1137696824 None] Lock "cinder-afecb067-5cf0-41c2-9eb2-18eaee428f50-delete_snapshot" released by "delete_snapshot" :: held 3.667s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:03 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32" returned: 0 in 0.788s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:03 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32 Jun 15 07:22:03 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:04 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19.d9e287eb-a2fb-432a-ba53-f4242b212d32" returned: 0 in 0.645s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-d9e287eb-a2fb-432a-ba53-f4242b212d32" released by "_delete_snapshot" :: held 3.365s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-f876eb92-8725-4c01-bcdf-797fa0e35c19" released by "delete_snapshot" :: held 3.398s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:04 devstack cinder-volume[92129]: WARNING cinder.quota [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-231629740 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-231629740, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:22:04 devstack cinder-volume[92129]: WARNING cinder.quota [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-231629740 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-231629740, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:22:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] Acquiring lock "cinder-d57abf1f-97b1-4b88-b3c7-c18e79a50cf2-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:04 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Created reservations ['54cdbbb4-0dbb-4b0b-8f7f-a472b234766b', 'cf352451-3432-41ab-aa71-f7a68d31a046', '6eb2a727-09be-468e-946b-84cab197b9d4', 'd8ee64d8-bc88-42d4-ba97-99c6afbc204f'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] Lock "cinder-d57abf1f-97b1-4b88-b3c7-c18e79a50cf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] Acquiring lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] Lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" acquired by "delete_snapshot" :: waited 0.033s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] Acquiring lock "cinder-quobyte-d57abf1f-97b1-4b88-b3c7-c18e79a50cf2" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] Lock "cinder-quobyte-d57abf1f-97b1-4b88-b3c7-c18e79a50cf2" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] Deleting offline snapshot d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 of volume 97ab4ee6-ead2-419c-a59f-dcdc357d0d7f {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:22:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] snapshot_file for this snap is: volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:22:04 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba67eb4a-290e-4af5-80ac-fb86034801ef]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:04 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] Created reservations ['b6a6663c-48e2-4c32-92c1-e05dceea5a1e', '9450bda9-63c8-4cd0-89b6-d00c88c8b84a', '4c633560-29e4-4e51-ab61-6ac12bb64fd3', '8cb139a8-61d8-4fdb-9811-3bc080392982'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:05 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 Jun 15 07:22:05 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:05 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-5f3e91c2-b4e5-4cd9-89ba-5cc439ffc848 tempest-GroupSnapshotsTest-869728579 None] group_snapshot db7502dd-cfbe-43c3-8f9f-51722648a675: deleted successfully Jun 15 07:22:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-2386b0f4-ae57-4da2-bcaf-977cf8483a00 req-55960faa-1fb6-4fcd-a3ec-a694407ae334 tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-2386b0f4-ae57-4da2-bcaf-977cf8483a00 req-55960faa-1fb6-4fcd-a3ec-a694407ae334 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:05 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd823f88-cd4c-4140-9af3-016a131edff0]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-2386b0f4-ae57-4da2-bcaf-977cf8483a00 req-55960faa-1fb6-4fcd-a3ec-a694407ae334 tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:05 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2" returned: 0 in 0.870s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:22:05 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35a67d3-3b60-4156-9af0-dd4e34c1f394]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:05 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d Jun 15 07:22:05 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:05 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f Jun 15 07:22:05 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:06 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "cinder-quobyte-9a01a825-adc8-4584-9836-b2dec44eb322" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:06 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-9a01a825-adc8-4584-9836-b2dec44eb322" acquired by "delete_volume" :: waited 0.031s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:06 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c84da6b-c298-4255-a383-5746a7b99f3e]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:06 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322 Jun 15 07:22:06 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:06 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-2386b0f4-ae57-4da2-bcaf-977cf8483a00 req-55960faa-1fb6-4fcd-a3ec-a694407ae334 tempest-AttachVolumeTestJSON-1407893396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d" returned: 0 in 0.984s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-2386b0f4-ae57-4da2-bcaf-977cf8483a00 req-55960faa-1fb6-4fcd-a3ec-a694407ae334 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.018s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-2386b0f4-ae57-4da2-bcaf-977cf8483a00 req-55960faa-1fb6-4fcd-a3ec-a694407ae334 tempest-AttachVolumeTestJSON-1407893396 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c750f72-d3c7-4dd3-9ec5-62a1dc61945a', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:22:06 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" returned: 0 in 0.957s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:06 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 Jun 15 07:22:06 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:06 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-2386b0f4-ae57-4da2-bcaf-977cf8483a00 req-55960faa-1fb6-4fcd-a3ec-a694407ae334 tempest-AttachVolumeTestJSON-1407893396 None] attachment_update completed successfully. Jun 15 07:22:07 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322" returned: 0 in 0.958s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:07 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322 Jun 15 07:22:07 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:07 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2" returned: 0 in 0.882s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:07 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2 Jun 15 07:22:07 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:07 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9a01a825-adc8-4584-9836-b2dec44eb322" returned: 0 in 0.769s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-9a01a825-adc8-4584-9836-b2dec44eb322" released by "delete_volume" :: held 1.817s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "cinder-quobyte-f876eb92-8725-4c01-bcdf-797fa0e35c19" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-f876eb92-8725-4c01-bcdf-797fa0e35c19" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:08 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[061453e1-9d8d-45bf-9602-13d1f3928a0d]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:08 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19 Jun 15 07:22:08 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:08 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f.d57abf1f-97b1-4b88-b3c7-c18e79a50cf2" returned: 0 in 0.843s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] Lock "cinder-quobyte-d57abf1f-97b1-4b88-b3c7-c18e79a50cf2" released by "_delete_snapshot" :: held 3.696s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] Lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" released by "delete_snapshot" :: held 3.740s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:08 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] Created reservations ['31e1f7ff-db4c-45c1-af0a-321d33ae9c3b', 'fa7fe801-9b3b-48ad-9164-5454d9d06ae4', 'a1c99e23-06d1-4a43-885c-23b692cb8a55', '7a3151c4-49b8-4efc-a45d-f9c85bacf66f'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:08 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] Delete snapshot completed successfully. Jun 15 07:22:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-532be408-9504-4df1-98c0-77172740be40 tempest-SnapshotsActionsTest-1531851628 None] Lock "cinder-d57abf1f-97b1-4b88-b3c7-c18e79a50cf2-delete_snapshot" released by "delete_snapshot" :: held 3.932s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:08 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19" returned: 0 in 0.811s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:08 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19 Jun 15 07:22:08 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] Acquiring lock "cinder-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] Lock "cinder-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] Acquiring lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] Lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" acquired by "delete_volume" :: waited 0.018s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:09 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c134684-9ec3-4404-b382-5f9948e63541]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:09 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f Jun 15 07:22:09 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:09 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f876eb92-8725-4c01-bcdf-797fa0e35c19" returned: 0 in 0.753s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-f876eb92-8725-4c01-bcdf-797fa0e35c19" released by "delete_volume" :: held 1.638s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:09 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Created reservations ['6b204919-eeb4-462e-b9b9-0a2167b39e4d'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:09 devstack cinder-volume[92129]: WARNING cinder.quota [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-231629740 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-231629740, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:22:09 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Created reservations ['e9a278b0-a5d9-420d-bc80-90628d035b3b', '4eddfa6c-4ea8-43d9-9d4d-22ee0650bf88', 'b7920a24-9925-4814-8888-019a4212abcd', '7daef2ec-78f5-44cf-9dbf-c1558afdd175'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:09 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Created reservations ['d5d8e3d1-567f-49d2-a20b-f70bbe8db96d', '4fb9aab5-a39e-4324-8757-b3445c404288', 'c4830bc8-84fb-4b10-8b00-50f2b5c41f82', 'cbd6bb4a-29a2-4997-99e4-bc8609f64a45'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:10 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" returned: 0 in 0.857s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:10 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f Jun 15 07:22:10 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:10 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:10 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:10 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:22:10 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:10 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" returned: 0 in 0.754s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] Lock "cinder-quobyte-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f" released by "delete_volume" :: held 1.726s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:10 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.767s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:10 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:22:10 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-ac1254f0-3c5f-4bfc-b044-c5d22818bc65 tempest-GroupSnapshotsTest-869728579 None] Delete group completed successfully. Jun 15 07:22:10 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] Created reservations ['c486a3d9-f0b3-4b41-ab81-b4805edc25a5', '9475bddc-8732-4fa4-b6a6-01f3f0726785', '355ce305-d432-4fef-b341-e44752db44b0', '85ef40a5-f06d-4b2b-9f53-a0a5a7ed2861'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:11 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:22:11 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:11 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-2c4bd74b-6eb3-430e-9c7e-ba0ef875f269 tempest-GroupSnapshotsTest-869728579 None] Group tempest-GroupSnapshotsTest-Group-1376670016: creating Jun 15 07:22:11 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-2c4bd74b-6eb3-430e-9c7e-ba0ef875f269 tempest-GroupSnapshotsTest-869728579 None] Group tempest-GroupSnapshotsTest-Group-1376670016: created successfully Jun 15 07:22:11 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-2c4bd74b-6eb3-430e-9c7e-ba0ef875f269 tempest-GroupSnapshotsTest-869728579 None] Create group completed successfully. Jun 15 07:22:11 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.716s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:11 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:22:11 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] Deleted volume successfully. Jun 15 07:22:11 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b74fa39f-6452-4aa3-81f5-e953976b9d37 tempest-SnapshotsActionsTest-1531851628 None] Lock "cinder-97ab4ee6-ead2-419c-a59f-dcdc357d0d7f-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Flow 'volume_create_manager' (871640aa-21aa-4a95-8e66-592ccfd24b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712c56b5-98e1-4b0b-a059-061aec9b2008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712c56b5-98e1-4b0b-a059-061aec9b2008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-37476189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5c7ecad-3ef8-418c-81fb-8cf72c5d72ee,host='devstack@QuobyteHD#QuobyteHD',id=4ac13140-7008-4cda-86d1-b2deb377b070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507aaf4064d14210ae90520f1875db68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:22:13Z,use_quota=True,user_id='a2cde9e162384edbaf95a66df9db0916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a038dd71-cd3d-4379-9192-90d42b7a9226),volume_type_id=a038dd71-cd3d-4379-9192-90d42b7a9226)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b42852b-ba58-40a6-b5d0-8c46b1e2c951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b42852b-ba58-40a6-b5d0-8c46b1e2c951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f119d7e-7a65-426d-bbf5-55fa5bbb5b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f119d7e-7a65-426d-bbf5-55fa5bbb5b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac13140-7008-4cda-86d1-b2deb377b070', 'volume_name': 'volume-4ac13140-7008-4cda-86d1-b2deb377b070', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e77e20-4769-41d5-8dfe-aec9daa88395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e77e20-4769-41d5-8dfe-aec9daa88395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f32aa49-e421-4c83-90e3-6fc1aa51ae7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:13 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Volume 4ac13140-7008-4cda-86d1-b2deb377b070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac13140-7008-4cda-86d1-b2deb377b070', 'volume_size': 1} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d5c7ecad-3ef8-418c-81fb-8cf72c5d72ee,created_at=2026-06-15T05:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-37476189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5c7ecad-3ef8-418c-81fb-8cf72c5d72ee,host='devstack@QuobyteHD#QuobyteHD',id=4ac13140-7008-4cda-86d1-b2deb377b070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507aaf4064d14210ae90520f1875db68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:22:13Z,use_quota=True,user_id='a2cde9e162384edbaf95a66df9db0916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a038dd71-cd3d-4379-9192-90d42b7a9226),volume_type_id=a038dd71-cd3d-4379-9192-90d42b7a9226)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Creating volume 4ac13140-7008-4cda-86d1-b2deb377b070 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:22:13 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:13 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070 1073741824 Jun 15 07:22:13 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:13 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:22:13 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:14 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070 1073741824" returned: 0 in 1.312s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:14 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070 Jun 15 07:22:14 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:14 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.028s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:14 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:22:14 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:22:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 8 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:22:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:22:15 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070" returned: 0 in 1.019s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:15 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] <== create_volume: return (2381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:22:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.385s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f32aa49-e421-4c83-90e3-6fc1aa51ae7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac13140-7008-4cda-86d1-b2deb377b070', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddaaaf0c-a476-4f76-9519-69e616d56110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:15 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Volume volume-4ac13140-7008-4cda-86d1-b2deb377b070 (4ac13140-7008-4cda-86d1-b2deb377b070): created successfully Jun 15 07:22:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddaaaf0c-a476-4f76-9519-69e616d56110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Flow 'volume_create_manager' (871640aa-21aa-4a95-8e66-592ccfd24b3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:22:15 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-e834a331-5817-4f2b-a6ba-a314bcb1fdf3 tempest-GroupSnapshotsTest-869728579 None] Created volume successfully. Jun 15 07:22:17 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] GroupSnapshot d8f11085-5828-42e3-85db-71b8803b703b: creating. Jun 15 07:22:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] Group snapshot d8f11085-5828-42e3-85db-71b8803b703b: creating. {{(pid=92129) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 15 07:22:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] Creating offline snapshot b8c12d97-d523-4751-986e-b3b862a5fa36 of volume 4ac13140-7008-4cda-86d1-b2deb377b070 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:22:17 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[698b7472-d973-43ec-acea-c8aaa12e3e7c]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:17 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070 Jun 15 07:22:17 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:18 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070" returned: 0 in 0.916s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:18 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36 1G Jun 15 07:22:18 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:19 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36 1G" returned: 0 in 1.117s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ac13140-7008-4cda-86d1-b2deb377b070 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:19 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ac13140-7008-4cda-86d1-b2deb377b070 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36 Jun 15 07:22:19 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:19 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ac13140-7008-4cda-86d1-b2deb377b070 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36" returned: 0 in 0.850s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:20 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36 is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:22:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:20 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36 Jun 15 07:22:20 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:20 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36" returned: 0 in 0.823s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:20 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:UPDATE=133,cinder:SELECT=133,cinder:INSERT=34,cinder:DELETE=9 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:22:20 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=135,cinder:UPDATE=136,cinder:INSERT=33,cinder:DELETE=3 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:22:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:20 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.info Jun 15 07:22:20 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:21 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.info" returned: 0 in 0.717s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:21 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.info is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:22:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:21 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.info Jun 15 07:22:21 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:22 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.info" returned: 0 in 0.653s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.213s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:22 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-37f0278c-6ed2-4346-93c6-b27d0fea29d2 tempest-GroupSnapshotsTest-869728579 None] group_snapshot d8f11085-5828-42e3-85db-71b8803b703b: created successfully Jun 15 07:22:23 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] group_snapshot d8f11085-5828-42e3-85db-71b8803b703b: deleting Jun 15 07:22:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] group_snapshot d8f11085-5828-42e3-85db-71b8803b703b: deleting {{(pid=92129) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 15 07:22:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "cinder-quobyte-4ac13140-7008-4cda-86d1-b2deb377b070" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-4ac13140-7008-4cda-86d1-b2deb377b070" acquired by "delete_snapshot" :: waited 0.031s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "cinder-quobyte-b8c12d97-d523-4751-986e-b3b862a5fa36" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-b8c12d97-d523-4751-986e-b3b862a5fa36" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] Deleting offline snapshot b8c12d97-d523-4751-986e-b3b862a5fa36 of volume 4ac13140-7008-4cda-86d1-b2deb377b070 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:22:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] snapshot_file for this snap is: volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:22:23 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84354af-53cb-4f07-99a6-541469d153b9]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:23 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36 Jun 15 07:22:23 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:24 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36" returned: 0 in 0.823s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ac13140-7008-4cda-86d1-b2deb377b070(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:22:24 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70335ea-f6f8-4b97-86bc-eeb3532db867]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:24 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070 Jun 15 07:22:24 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:25 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070" returned: 0 in 0.867s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:25 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36 Jun 15 07:22:25 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:26 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36" returned: 0 in 1.063s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:26 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36 Jun 15 07:22:26 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:27 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070.b8c12d97-d523-4751-986e-b3b862a5fa36" returned: 0 in 1.283s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-b8c12d97-d523-4751-986e-b3b862a5fa36" released by "_delete_snapshot" :: held 4.219s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-4ac13140-7008-4cda-86d1-b2deb377b070" released by "delete_snapshot" :: held 4.274s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:28 devstack cinder-volume[92129]: WARNING cinder.quota [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-733274915 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-733274915, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:22:28 devstack cinder-volume[92129]: WARNING cinder.quota [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-733274915 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-733274915, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:22:28 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] Created reservations ['8abdb524-5e2c-4f18-a2af-c5fd22d4c8d9', '44055c11-015b-48fa-9288-5d221e69172a', 'a745bc1e-6fda-4118-94c1-64771ecd9e20', '54dedee4-1ac4-4683-b55d-f02c731c09d5'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:28 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-989da651-aefb-40c1-8755-bb89d8be61e0 tempest-GroupSnapshotsTest-869728579 None] group_snapshot d8f11085-5828-42e3-85db-71b8803b703b: deleted successfully Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Flow 'volume_create_manager' (6fc82665-4d28-4b5d-97f8-b5d837b39f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a219abc0-dbda-47b5-98de-953772e2a632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a219abc0-dbda-47b5-98de-953772e2a632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1394449916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=749d91ee-1500-49d8-9506-7d753232c613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda3d3d240e241d886e3f250a4d741cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:22:29Z,use_quota=True,user_id='647af24477914c698d067e5504cf8070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93de8c23-4ce7-4fa3-8bc1-c73ec44f2189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93de8c23-4ce7-4fa3-8bc1-c73ec44f2189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6488fde-c96f-43ca-9b9f-b5bd09d6cb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6488fde-c96f-43ca-9b9f-b5bd09d6cb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '749d91ee-1500-49d8-9506-7d753232c613', 'volume_name': 'volume-749d91ee-1500-49d8-9506-7d753232c613', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121783c6-91f5-403b-afbd-e13e46184a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121783c6-91f5-403b-afbd-e13e46184a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79da94a0-4362-4796-a512-59dbc526d10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:29 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Volume 749d91ee-1500-49d8-9506-7d753232c613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-749d91ee-1500-49d8-9506-7d753232c613', 'volume_size': 1} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1394449916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=749d91ee-1500-49d8-9506-7d753232c613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda3d3d240e241d886e3f250a4d741cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:22:29Z,use_quota=True,user_id='647af24477914c698d067e5504cf8070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Creating volume 749d91ee-1500-49d8-9506-7d753232c613 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:22:29 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:29 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613 1073741824 Jun 15 07:22:29 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "cinder-quobyte-4ac13140-7008-4cda-86d1-b2deb377b070" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:29 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-4ac13140-7008-4cda-86d1-b2deb377b070" acquired by "delete_volume" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:30 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[67734a30-792d-4557-b14d-efe98f4528a3]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:30 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070 Jun 15 07:22:30 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:31 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613 1073741824" returned: 0 in 1.372s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:31 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070" returned: 0 in 0.994s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:31 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070 Jun 15 07:22:31 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:31 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613 Jun 15 07:22:31 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:31 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613" returned: 0 in 0.772s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] <== create_volume: return (2219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:22:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:31 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ac13140-7008-4cda-86d1-b2deb377b070" returned: 0 in 0.830s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79da94a0-4362-4796-a512-59dbc526d10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-749d91ee-1500-49d8-9506-7d753232c613', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a265a38-d7da-42e7-8d6f-654edfa85eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] Lock "cinder-quobyte-4ac13140-7008-4cda-86d1-b2deb377b070" released by "delete_volume" :: held 1.912s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:31 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Volume volume-749d91ee-1500-49d8-9506-7d753232c613 (749d91ee-1500-49d8-9506-7d753232c613): created successfully Jun 15 07:22:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a265a38-d7da-42e7-8d6f-654edfa85eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Flow 'volume_create_manager' (6fc82665-4d28-4b5d-97f8-b5d837b39f19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:22:31 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-4df1b8c3-df2f-4566-86f5-857d31892e28 tempest-SnapshotMetadataTestJSON-511395119 None] Created volume successfully. Jun 15 07:22:31 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] Created reservations ['3e562e62-3b9e-41a6-a7f7-6668afa4caa3'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:32 devstack cinder-volume[92129]: WARNING cinder.quota [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-733274915 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-733274915, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:22:32 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] Created reservations ['21f33e52-3e27-439b-a917-dc9a3d7ae013', '9f8434d4-04a9-4d50-98ad-b1b6a6dd2822', '3f258dba-ee5a-4dac-b43a-0874bab2c0e6', '09038367-ea74-4565-9dc1-0046ec5e5a8c'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:32 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:22:32 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:33 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.871s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:33 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:22:33 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-e2070a26-6ab2-4c5e-8e12-c188b55a9ae9 tempest-GroupSnapshotsTest-869728579 None] Delete group completed successfully. Jun 15 07:22:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] Creating offline snapshot 3f3725ff-1080-4f84-bc8c-16e57bcad09d of volume 749d91ee-1500-49d8-9506-7d753232c613 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:22:33 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a64a116-9b28-4810-8af9-c8e4443c9c84]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:33 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613 Jun 15 07:22:33 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:34 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613" returned: 0 in 0.889s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:34 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d 1G Jun 15 07:22:34 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:35 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d 1G" returned: 0 in 1.032s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-749d91ee-1500-49d8-9506-7d753232c613 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:35 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-749d91ee-1500-49d8-9506-7d753232c613 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d Jun 15 07:22:35 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:36 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-749d91ee-1500-49d8-9506-7d753232c613 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d" returned: 0 in 1.723s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:36 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d is being set with open permissions: ugo+rw Jun 15 07:22:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:36 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d Jun 15 07:22:36 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:37 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d" returned: 0 in 1.003s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:37 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.info Jun 15 07:22:37 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:38 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.info" returned: 0 in 0.960s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:38 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.info is being set with open permissions: ugo+rw Jun 15 07:22:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:38 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.info Jun 15 07:22:38 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:39 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.info" returned: 0 in 1.114s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.890s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:40 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-3a771329-c911-42d7-b510-86682c78a3d1 tempest-SnapshotMetadataTestJSON-511395119 None] Create snapshot completed successfully Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Flow 'volume_create_manager' (2494f632-5078-4e49-9fb6-4bb79ed473b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659069fb-03b3-4653-b6b6-658a04b7dda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659069fb-03b3-4653-b6b6-658a04b7dda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-652527175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c482cd0b-98d4-4339-9616-38bfe54c1d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f396b05fa1d4245b5adbfe1847901fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:22:40Z,use_quota=True,user_id='b930941ebc604e0bbb0cea0064a0bbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c8ecd3-e5cc-456d-9aa0-d27d8f1dda85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c8ecd3-e5cc-456d-9aa0-d27d8f1dda85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a05c703-3f66-4f95-856c-8fcab3aaa9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a05c703-3f66-4f95-856c-8fcab3aaa9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c482cd0b-98d4-4339-9616-38bfe54c1d20', 'volume_name': 'volume-c482cd0b-98d4-4339-9616-38bfe54c1d20', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ea01a5-7e26-4542-85dc-239582b2b90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ea01a5-7e26-4542-85dc-239582b2b90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85871b42-3704-459e-9d7e-a163782e3946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:40 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Volume c482cd0b-98d4-4339-9616-38bfe54c1d20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c482cd0b-98d4-4339-9616-38bfe54c1d20', 'volume_size': 1} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-652527175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c482cd0b-98d4-4339-9616-38bfe54c1d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f396b05fa1d4245b5adbfe1847901fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:22:40Z,use_quota=True,user_id='b930941ebc604e0bbb0cea0064a0bbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Creating volume c482cd0b-98d4-4339-9616-38bfe54c1d20 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:22:40 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:22:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c482cd0b-98d4-4339-9616-38bfe54c1d20 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:40 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c482cd0b-98d4-4339-9616-38bfe54c1d20 1073741824 Jun 15 07:22:40 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:41 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-7ac065fa-624e-446f-b1c5-3122ecf66bd1 tempest-GroupSnapshotsV319Test-2064597046 None] Group tempest-GroupSnapshotsV319Test-Group-583776638: creating Jun 15 07:22:41 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-7ac065fa-624e-446f-b1c5-3122ecf66bd1 tempest-GroupSnapshotsV319Test-2064597046 None] Group tempest-GroupSnapshotsV319Test-Group-583776638: created successfully Jun 15 07:22:41 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-7ac065fa-624e-446f-b1c5-3122ecf66bd1 tempest-GroupSnapshotsV319Test-2064597046 None] Create group completed successfully. Jun 15 07:22:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] Acquiring lock "cinder-3f3725ff-1080-4f84-bc8c-16e57bcad09d-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] Lock "cinder-3f3725ff-1080-4f84-bc8c-16e57bcad09d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] Acquiring lock "cinder-quobyte-749d91ee-1500-49d8-9506-7d753232c613" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] Lock "cinder-quobyte-749d91ee-1500-49d8-9506-7d753232c613" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] Acquiring lock "cinder-quobyte-3f3725ff-1080-4f84-bc8c-16e57bcad09d" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] Lock "cinder-quobyte-3f3725ff-1080-4f84-bc8c-16e57bcad09d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:41 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] Deleting offline snapshot 3f3725ff-1080-4f84-bc8c-16e57bcad09d of volume 749d91ee-1500-49d8-9506-7d753232c613 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:22:41 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] snapshot_file for this snap is: volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:22:41 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0e57f7-28a8-42a8-8565-868fa6a73851]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:42 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d Jun 15 07:22:42 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:42 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c482cd0b-98d4-4339-9616-38bfe54c1d20 1073741824" returned: 0 in 1.613s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c482cd0b-98d4-4339-9616-38bfe54c1d20 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:42 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c482cd0b-98d4-4339-9616-38bfe54c1d20 Jun 15 07:22:42 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:42 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d" returned: 0 in 0.832s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-749d91ee-1500-49d8-9506-7d753232c613(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:22:42 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e776c745-d516-4f53-991e-7939987e10f5]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:42 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613 Jun 15 07:22:42 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:42 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c482cd0b-98d4-4339-9616-38bfe54c1d20" returned: 0 in 0.716s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] <== create_volume: return (2382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:22:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.385s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85871b42-3704-459e-9d7e-a163782e3946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c482cd0b-98d4-4339-9616-38bfe54c1d20', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c7d183-25f7-47a6-a5e1-2e41db6b1132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:42 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Volume volume-c482cd0b-98d4-4339-9616-38bfe54c1d20 (c482cd0b-98d4-4339-9616-38bfe54c1d20): created successfully Jun 15 07:22:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c7d183-25f7-47a6-a5e1-2e41db6b1132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Flow 'volume_create_manager' (2494f632-5078-4e49-9fb6-4bb79ed473b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:22:43 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-04f8a0b6-8e34-46fb-b550-f3d449213175 tempest-VolumesActionsTest-444549829 None] Created volume successfully. Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Flow 'volume_create_manager' (9615b71f-2b65-4c0d-9f78-789aa98a57e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce10c2f-b8a7-48c9-b192-d1cf07a3d69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce10c2f-b8a7-48c9-b192-d1cf07a3d69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-267864635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1817b595-30a0-492f-901c-edd2c6da0327,host='devstack@QuobyteHD#QuobyteHD',id=ee7ff0a9-1c35-4166-9c65-0720411e5f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f565cd2f44c44aeb724761b16ea9eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:22:43Z,use_quota=True,user_id='fdb86f11e460477ea53184bd3e599534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00c49cd1-6d32-483f-bbcc-48f306066493),volume_type_id=00c49cd1-6d32-483f-bbcc-48f306066493)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0826e7-b72f-4013-9a06-3b2c0ceedb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0826e7-b72f-4013-9a06-3b2c0ceedb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed550494-f89b-4c9c-ae9d-36c7289bb7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed550494-f89b-4c9c-ae9d-36c7289bb7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee7ff0a9-1c35-4166-9c65-0720411e5f66', 'volume_name': 'volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915946bd-45be-4904-96eb-356189ec1438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915946bd-45be-4904-96eb-356189ec1438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714a9023-a841-41ea-b4c9-5e8767cfa473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:43 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Volume ee7ff0a9-1c35-4166-9c65-0720411e5f66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66', 'volume_size': 1} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1817b595-30a0-492f-901c-edd2c6da0327,created_at=2026-06-15T05:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-267864635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1817b595-30a0-492f-901c-edd2c6da0327,host='devstack@QuobyteHD#QuobyteHD',id=ee7ff0a9-1c35-4166-9c65-0720411e5f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f565cd2f44c44aeb724761b16ea9eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:22:43Z,use_quota=True,user_id='fdb86f11e460477ea53184bd3e599534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00c49cd1-6d32-483f-bbcc-48f306066493),volume_type_id=00c49cd1-6d32-483f-bbcc-48f306066493)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Creating volume ee7ff0a9-1c35-4166-9c65-0720411e5f66 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:22:43 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:43 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66 1073741824 Jun 15 07:22:43 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:43 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613" returned: 0 in 0.832s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:43 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d Jun 15 07:22:43 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-531c6e93-3d18-44fe-b149-f6ff3a8227d1 tempest-VolumesActionsTest-444549829 None] Acquiring lock "cinder-c482cd0b-98d4-4339-9616-38bfe54c1d20" by "attach_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-531c6e93-3d18-44fe-b149-f6ff3a8227d1 tempest-VolumesActionsTest-444549829 None] Lock "cinder-c482cd0b-98d4-4339-9616-38bfe54c1d20" acquired by "attach_volume" :: waited 0.041s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:43 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-531c6e93-3d18-44fe-b149-f6ff3a8227d1 tempest-VolumesActionsTest-444549829 None] Attaching volume c482cd0b-98d4-4339-9616-38bfe54c1d20 to instance 8984b083-6a06-426f-b6dc-46752d63a0f2 at mountpoint /dev/vdb on host None. Jun 15 07:22:43 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-531c6e93-3d18-44fe-b149-f6ff3a8227d1 tempest-VolumesActionsTest-444549829 None] Attach volume completed successfully. Jun 15 07:22:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-531c6e93-3d18-44fe-b149-f6ff3a8227d1 tempest-VolumesActionsTest-444549829 None] Lock "cinder-c482cd0b-98d4-4339-9616-38bfe54c1d20" released by "attach_volume" :: held 0.125s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:44 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66 1073741824" returned: 0 in 0.993s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:44 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66 Jun 15 07:22:44 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:44 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d" returned: 0 in 0.984s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:44 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d Jun 15 07:22:44 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:44 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-6ad61477-ca48-4def-8252-7e8b8e6bd965 tempest-VolumesActionsTest-1679402068 None] Terminate volume connection completed successfully. Jun 15 07:22:45 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66" returned: 0 in 0.732s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714a9023-a841-41ea-b4c9-5e8767cfa473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ca78be-b4e3-4d1a-a7d8-0d6f21547014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:45 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Volume volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66 (ee7ff0a9-1c35-4166-9c65-0720411e5f66): created successfully Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ca78be-b4e3-4d1a-a7d8-0d6f21547014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Flow 'volume_create_manager' (9615b71f-2b65-4c0d-9f78-789aa98a57e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:22:45 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-5aeb2035-5cf2-44fd-9585-006e54387a37 tempest-GroupSnapshotsV319Test-2064597046 None] Created volume successfully. Jun 15 07:22:45 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613.3f3725ff-1080-4f84-bc8c-16e57bcad09d" returned: 0 in 0.728s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] Lock "cinder-quobyte-3f3725ff-1080-4f84-bc8c-16e57bcad09d" released by "_delete_snapshot" :: held 3.490s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] Lock "cinder-quobyte-749d91ee-1500-49d8-9506-7d753232c613" released by "delete_snapshot" :: held 3.524s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] Created reservations ['2670c9c3-1fe6-4dcd-bae7-9af5df3ea5e8', '01b4ce8f-02b4-4ef1-a886-368bbcd1aca2', '18f47ca3-b50b-4fb6-8235-91872f104fd2', 'f8f170a0-d6f0-49ff-a5c9-6a8d6e1597ad'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6ad61477-ca48-4def-8252-7e8b8e6bd965 tempest-VolumesActionsTest-1679402068 None] Acquiring lock "cinder-c482cd0b-98d4-4339-9616-38bfe54c1d20-detach_volume" by "detach_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6ad61477-ca48-4def-8252-7e8b8e6bd965 tempest-VolumesActionsTest-1679402068 None] Lock "cinder-c482cd0b-98d4-4339-9616-38bfe54c1d20-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:45 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-6ad61477-ca48-4def-8252-7e8b8e6bd965 tempest-VolumesActionsTest-1679402068 None] Detaching volume c482cd0b-98d4-4339-9616-38bfe54c1d20 from instance 8984b083-6a06-426f-b6dc-46752d63a0f2. Jun 15 07:22:45 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] Delete snapshot completed successfully. Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-d985ec48-5b70-4439-a15f-d2f2671269cd tempest-SnapshotMetadataTestJSON-511395119 None] Lock "cinder-3f3725ff-1080-4f84-bc8c-16e57bcad09d-delete_snapshot" released by "delete_snapshot" :: held 3.747s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:45 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-6ad61477-ca48-4def-8252-7e8b8e6bd965 tempest-VolumesActionsTest-1679402068 None] Detach volume completed successfully. Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6ad61477-ca48-4def-8252-7e8b8e6bd965 tempest-VolumesActionsTest-1679402068 None] Lock "cinder-c482cd0b-98d4-4339-9616-38bfe54c1d20-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:45 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] GroupSnapshot f5f9ad1b-d9aa-4e72-b8ce-621dbfbd781b: creating. Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] Group snapshot f5f9ad1b-d9aa-4e72-b8ce-621dbfbd781b: creating. {{(pid=92129) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] Creating offline snapshot f48b4529-ecc0-4d2d-bb3c-3324f579160b of volume ee7ff0a9-1c35-4166-9c65-0720411e5f66 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeaaec4-12c0-41d6-9272-1acc230199ec]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:45 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66 Jun 15 07:22:45 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1dc008a2-be00-4753-b999-18550f8fc654 tempest-VolumesActionsTest-444549829 None] Acquiring lock "cinder-c482cd0b-98d4-4339-9616-38bfe54c1d20-detach_volume" by "detach_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1dc008a2-be00-4753-b999-18550f8fc654 tempest-VolumesActionsTest-444549829 None] Lock "cinder-c482cd0b-98d4-4339-9616-38bfe54c1d20-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:46 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-1dc008a2-be00-4753-b999-18550f8fc654 tempest-VolumesActionsTest-444549829 None] Volume detach called, but volume not attached. Jun 15 07:22:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1dc008a2-be00-4753-b999-18550f8fc654 tempest-VolumesActionsTest-444549829 None] Lock "cinder-c482cd0b-98d4-4339-9616-38bfe54c1d20-detach_volume" released by "detach_volume" :: held 0.027s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] Acquiring lock "cinder-749d91ee-1500-49d8-9506-7d753232c613-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] Lock "cinder-749d91ee-1500-49d8-9506-7d753232c613-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] Acquiring lock "cinder-quobyte-749d91ee-1500-49d8-9506-7d753232c613" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] Lock "cinder-quobyte-749d91ee-1500-49d8-9506-7d753232c613" acquired by "delete_volume" :: waited 0.021s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:46 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[410381ea-74d1-464a-abd3-90f8f0b303c4]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:46 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613 Jun 15 07:22:46 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:46 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66" returned: 0 in 0.831s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:46 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b 1G Jun 15 07:22:46 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] Acquiring lock "cinder-c482cd0b-98d4-4339-9616-38bfe54c1d20-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] Lock "cinder-c482cd0b-98d4-4339-9616-38bfe54c1d20-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] Acquiring lock "cinder-quobyte-c482cd0b-98d4-4339-9616-38bfe54c1d20" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] Lock "cinder-quobyte-c482cd0b-98d4-4339-9616-38bfe54c1d20" acquired by "delete_volume" :: waited 0.020s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:47 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2d76c4-69b0-40ff-8ca0-53089183a6a1]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c482cd0b-98d4-4339-9616-38bfe54c1d20 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:47 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c482cd0b-98d4-4339-9616-38bfe54c1d20 Jun 15 07:22:47 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:47 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613" returned: 0 in 0.995s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:47 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613 Jun 15 07:22:47 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:47 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b 1G" returned: 0 in 1.174s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:47 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b Jun 15 07:22:47 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:47 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c482cd0b-98d4-4339-9616-38bfe54c1d20" returned: 0 in 0.865s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c482cd0b-98d4-4339-9616-38bfe54c1d20 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:48 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c482cd0b-98d4-4339-9616-38bfe54c1d20 Jun 15 07:22:48 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:48 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-749d91ee-1500-49d8-9506-7d753232c613" returned: 0 in 1.001s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] Lock "cinder-quobyte-749d91ee-1500-49d8-9506-7d753232c613" released by "delete_volume" :: held 2.083s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:48 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] Created reservations ['01d9d8b4-6f87-4d02-847a-3f1a53a6d24b', 'ce5d9934-0e2d-4e10-99d3-9863cad0bd04', 'eb31f4fa-2e12-468f-a385-f6d02485b06d', '4a918633-71a6-4363-8c12-05e87d14697a'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:48 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:22:48 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:49 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c482cd0b-98d4-4339-9616-38bfe54c1d20" returned: 0 in 1.095s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] Lock "cinder-quobyte-c482cd0b-98d4-4339-9616-38bfe54c1d20" released by "delete_volume" :: held 2.049s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:49 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b" returned: 0 in 1.385s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:49 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:22:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:49 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b Jun 15 07:22:49 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:49 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] Created reservations ['a7b9f04b-6ed2-4205-83c5-68b2d933e6f8', 'bcb6616e-a84e-478c-a703-27f845c00177', '0f05e4f7-79e7-4ba5-b6cb-a23a44ce7fc0', '7861f73d-dcbb-4676-8f90-b1caa2d882ed'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:49 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:22:49 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:49 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.223s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:49 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:22:50 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] Deleted volume successfully. Jun 15 07:22:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5d087178-b913-423d-9436-157d67212890 tempest-SnapshotMetadataTestJSON-511395119 None] Lock "cinder-749d91ee-1500-49d8-9506-7d753232c613-delete_volume" released by "delete_volume" :: held 3.797s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:50 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b" returned: 0 in 1.612s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:50 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.info Jun 15 07:22:50 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:51 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.581s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:51 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:22:51 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] Deleted volume successfully. Jun 15 07:22:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e3b30134-7ae1-4758-90a7-910dc3592aa7 tempest-VolumesActionsTest-444549829 None] Lock "cinder-c482cd0b-98d4-4339-9616-38bfe54c1d20-delete_volume" released by "delete_volume" :: held 4.202s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:52 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.info" returned: 0 in 1.135s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:52 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.info is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:22:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:52 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.info Jun 15 07:22:52 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:52 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.info" returned: 0 in 0.896s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.154s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:53 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-7e5bf82a-a437-4660-bb93-c28fdf733371 req-8b6fbd67-95de-41f1-9599-2e0f49fafc66 tempest-AttachVolumeTestJSON-1407893396 None] Terminate volume connection completed successfully. Jun 15 07:22:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-7e5bf82a-a437-4660-bb93-c28fdf733371 req-8b6fbd67-95de-41f1-9599-2e0f49fafc66 tempest-AttachVolumeTestJSON-1407893396 None] Deleting attachment 7c750f72-d3c7-4dd3-9ec5-62a1dc61945a. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:22:53 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0484222a-8ffb-45ce-b039-a5ff704a4617 tempest-GroupSnapshotsV319Test-2064597046 None] group_snapshot f5f9ad1b-d9aa-4e72-b8ce-621dbfbd781b: created successfully Jun 15 07:22:53 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] group_snapshot f5f9ad1b-d9aa-4e72-b8ce-621dbfbd781b: deleting Jun 15 07:22:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] group_snapshot f5f9ad1b-d9aa-4e72-b8ce-621dbfbd781b: deleting {{(pid=92129) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 15 07:22:53 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] Acquiring lock "cinder-quobyte-ee7ff0a9-1c35-4166-9c65-0720411e5f66" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:53 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] Lock "cinder-quobyte-ee7ff0a9-1c35-4166-9c65-0720411e5f66" acquired by "delete_snapshot" :: waited 0.023s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:54 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] Acquiring lock "cinder-quobyte-f48b4529-ecc0-4d2d-bb3c-3324f579160b" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:54 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] Lock "cinder-quobyte-f48b4529-ecc0-4d2d-bb3c-3324f579160b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] Deleting offline snapshot f48b4529-ecc0-4d2d-bb3c-3324f579160b of volume ee7ff0a9-1c35-4166-9c65-0720411e5f66 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:22:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] snapshot_file for this snap is: volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:22:54 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13f5371-5d28-4887-b05c-84ea49a8c824]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:54 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b Jun 15 07:22:54 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:54 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b" returned: 0 in 0.862s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:22:54 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddb2fd2-8a17-421c-bce5-cba0ee706b3f]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:55 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66 Jun 15 07:22:55 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66" returned: 0 in 0.881s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:55 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:55 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b Jun 15 07:22:55 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Flow 'volume_create_manager' (e7a0c804-1f91-41d8-9cbc-d52887f3d967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (072ce2af-cdff-448c-81a1-6289701bc6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (072ce2af-cdff-448c-81a1-6289701bc6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-77837005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6165e6-23da-465f-966f-4232670bce07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3996e24e7b214c8baa1c18dfd756f79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:22:57Z,use_quota=True,user_id='d61b724ae828467980f7e726b586d6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a61e341-a4b4-4627-ac89-f69462541465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a61e341-a4b4-4627-ac89-f69462541465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98ea628-5a4c-4cf3-92e9-b5f63e384642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:56 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98ea628-5a4c-4cf3-92e9-b5f63e384642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a6165e6-23da-465f-966f-4232670bce07', 'volume_name': 'volume-3a6165e6-23da-465f-966f-4232670bce07', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858a2460-956f-49b6-82ce-4ad05490a3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858a2460-956f-49b6-82ce-4ad05490a3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042145f6-0331-463d-9c04-59358cbf98e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:56 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Volume 3a6165e6-23da-465f-966f-4232670bce07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a6165e6-23da-465f-966f-4232670bce07', 'volume_size': 1} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-77837005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6165e6-23da-465f-966f-4232670bce07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3996e24e7b214c8baa1c18dfd756f79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:22:57Z,use_quota=True,user_id='d61b724ae828467980f7e726b586d6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Creating volume 3a6165e6-23da-465f-966f-4232670bce07 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:22:56 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-3a6165e6-23da-465f-966f-4232670bce07 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b" returned: 0 in 1.040s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:56 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-3a6165e6-23da-465f-966f-4232670bce07 1073741824 Jun 15 07:22:56 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:56 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b Jun 15 07:22:56 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:57 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66.f48b4529-ecc0-4d2d-bb3c-3324f579160b" returned: 0 in 0.698s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:57 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] Lock "cinder-quobyte-f48b4529-ecc0-4d2d-bb3c-3324f579160b" released by "_delete_snapshot" :: held 3.581s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:57 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] Lock "cinder-quobyte-ee7ff0a9-1c35-4166-9c65-0720411e5f66" released by "delete_snapshot" :: held 3.625s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:57 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-3a6165e6-23da-465f-966f-4232670bce07 1073741824" returned: 0 in 0.824s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:57 devstack cinder-volume[92129]: WARNING cinder.quota [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-259743827 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-259743827, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:22:57 devstack cinder-volume[92129]: WARNING cinder.quota [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-259743827 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-259743827, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:22:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-3a6165e6-23da-465f-966f-4232670bce07 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:57 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] Created reservations ['b00211b3-2026-4cba-a534-96cf1b8598b9', '2c4b9532-e4f0-46e0-9628-e7c825ab7b9d', 'a5285569-d855-4f8a-a597-267b75b2468c', '3f048ee0-d249-4537-9b70-7b3b37533b9f'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:57 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-3a6165e6-23da-465f-966f-4232670bce07 Jun 15 07:22:57 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:57 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-604826cf-6775-4ba5-be1d-a9c7c181fbcb tempest-GroupSnapshotsV319Test-2064597046 None] group_snapshot f5f9ad1b-d9aa-4e72-b8ce-621dbfbd781b: deleted successfully Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Flow 'volume_create_manager' (149527b0-03fa-49f7-b00d-db7978b55044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a519d051-92c9-4b9a-b157-025d0502d81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a519d051-92c9-4b9a-b157-025d0502d81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-874042065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77967f4b-02cf-47ff-ae74-3a1109a303fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f396b05fa1d4245b5adbfe1847901fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:22:58Z,use_quota=True,user_id='b930941ebc604e0bbb0cea0064a0bbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99d0ecd-2fb9-4e16-8d66-23905dfca702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99d0ecd-2fb9-4e16-8d66-23905dfca702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95288f0-2e20-448b-ba33-ce831bdbbc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95288f0-2e20-448b-ba33-ce831bdbbc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77967f4b-02cf-47ff-ae74-3a1109a303fc', 'volume_name': 'volume-77967f4b-02cf-47ff-ae74-3a1109a303fc', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a846fc-6aa4-4a54-bed5-9e9b9a7c8bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a846fc-6aa4-4a54-bed5-9e9b9a7c8bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2517267-39ad-4779-8557-7162335749a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:58 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Volume 77967f4b-02cf-47ff-ae74-3a1109a303fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77967f4b-02cf-47ff-ae74-3a1109a303fc', 'volume_size': 1} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:58 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-3a6165e6-23da-465f-966f-4232670bce07" returned: 0 in 0.647s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.067s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-874042065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77967f4b-02cf-47ff-ae74-3a1109a303fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f396b05fa1d4245b5adbfe1847901fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:22:58Z,use_quota=True,user_id='b930941ebc604e0bbb0cea0064a0bbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Creating volume 77967f4b-02cf-47ff-ae74-3a1109a303fc {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:22:58 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-77967f4b-02cf-47ff-ae74-3a1109a303fc 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042145f6-0331-463d-9c04-59358cbf98e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a6165e6-23da-465f-966f-4232670bce07', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:58 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-77967f4b-02cf-47ff-ae74-3a1109a303fc 1073741824 Jun 15 07:22:58 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2674df-7c36-4ffe-8e1a-172ed2f4acb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:58 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Volume volume-3a6165e6-23da-465f-966f-4232670bce07 (3a6165e6-23da-465f-966f-4232670bce07): created successfully Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2674df-7c36-4ffe-8e1a-172ed2f4acb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Flow 'volume_create_manager' (e7a0c804-1f91-41d8-9cbc-d52887f3d967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:22:58 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-334f7a27-3cd3-4460-ab33-3176d4e2fd27 tempest-VolumesTransfersV355Test-651884003 None] Created volume successfully. Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] Acquiring lock "cinder-quobyte-ee7ff0a9-1c35-4166-9c65-0720411e5f66" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] Lock "cinder-quobyte-ee7ff0a9-1c35-4166-9c65-0720411e5f66" acquired by "delete_volume" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[998a1e23-4ed0-47eb-a1b4-40a7915f29eb]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:58 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66 Jun 15 07:22:58 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:59 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-77967f4b-02cf-47ff-ae74-3a1109a303fc 1073741824" returned: 0 in 0.985s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-77967f4b-02cf-47ff-ae74-3a1109a303fc {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:59 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-77967f4b-02cf-47ff-ae74-3a1109a303fc Jun 15 07:22:59 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:59 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66" returned: 0 in 0.870s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:59 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66 Jun 15 07:22:59 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:59 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-d279752a-88f5-458e-a7f3-9bea27742294 tempest-VolumesTransfersV355Test-1054668684 None] Transfer volume completed successfully. Jun 15 07:23:00 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-77967f4b-02cf-47ff-ae74-3a1109a303fc" returned: 0 in 0.684s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2517267-39ad-4779-8557-7162335749a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77967f4b-02cf-47ff-ae74-3a1109a303fc', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaddf5d3-68ae-4f31-910b-b5ee6caf3e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:00 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Volume volume-77967f4b-02cf-47ff-ae74-3a1109a303fc (77967f4b-02cf-47ff-ae74-3a1109a303fc): created successfully Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaddf5d3-68ae-4f31-910b-b5ee6caf3e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Flow 'volume_create_manager' (149527b0-03fa-49f7-b00d-db7978b55044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:00 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ee7ff0a9-1c35-4166-9c65-0720411e5f66" returned: 0 in 0.696s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:00 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-91bd21b5-d83a-4d29-9e09-fe25766a9204 tempest-VolumesActionsTest-444549829 None] Created volume successfully. Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] Lock "cinder-quobyte-ee7ff0a9-1c35-4166-9c65-0720411e5f66" released by "delete_volume" :: held 1.661s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] Created reservations ['d92c7437-7f08-46df-80c6-5a9a59a4d225'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:23:00 devstack cinder-volume[92129]: WARNING cinder.quota [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-259743827 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-259743827, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] Created reservations ['277e47f9-5a4f-4167-8573-01ac10fd524e', '40be90a4-d0e2-4f9f-b383-9ba7d912054c', '0607362e-e92c-400e-9f87-afb1a1b09445', 'a6e3eb1a-6d34-4db4-8d14-4aa9c00ead15'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:00 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:23:00 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] Acquiring lock "cinder-77967f4b-02cf-47ff-ae74-3a1109a303fc-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] Lock "cinder-77967f4b-02cf-47ff-ae74-3a1109a303fc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] Acquiring lock "cinder-3a6165e6-23da-465f-966f-4232670bce07-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] Lock "cinder-3a6165e6-23da-465f-966f-4232670bce07-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] Acquiring lock "cinder-quobyte-77967f4b-02cf-47ff-ae74-3a1109a303fc" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] Lock "cinder-quobyte-77967f4b-02cf-47ff-ae74-3a1109a303fc" acquired by "delete_volume" :: waited 0.036s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[047c720f-eab7-4c47-8f93-d1436d4a1759]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-77967f4b-02cf-47ff-ae74-3a1109a303fc {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] Acquiring lock "cinder-quobyte-3a6165e6-23da-465f-966f-4232670bce07" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] Lock "cinder-quobyte-3a6165e6-23da-465f-966f-4232670bce07" acquired by "delete_volume" :: waited 0.026s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db3816c-0c1d-4962-af13-0bcfe81b6116]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-3a6165e6-23da-465f-966f-4232670bce07 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:00 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-77967f4b-02cf-47ff-ae74-3a1109a303fc Jun 15 07:23:00 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:00 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-3a6165e6-23da-465f-966f-4232670bce07 Jun 15 07:23:00 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:01 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.884s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:01 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:23:01 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-9db8c547-0f31-45ea-b25d-e1fcc3b45c6c tempest-GroupSnapshotsV319Test-2064597046 None] Delete group completed successfully. Jun 15 07:23:01 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-77967f4b-02cf-47ff-ae74-3a1109a303fc" returned: 0 in 0.910s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-77967f4b-02cf-47ff-ae74-3a1109a303fc {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:01 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-77967f4b-02cf-47ff-ae74-3a1109a303fc Jun 15 07:23:01 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:01 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-3a6165e6-23da-465f-966f-4232670bce07" returned: 0 in 0.908s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-3a6165e6-23da-465f-966f-4232670bce07 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:01 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-3a6165e6-23da-465f-966f-4232670bce07 Jun 15 07:23:01 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:02 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-77967f4b-02cf-47ff-ae74-3a1109a303fc" returned: 0 in 0.709s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:02 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] Lock "cinder-quobyte-77967f4b-02cf-47ff-ae74-3a1109a303fc" released by "delete_volume" :: held 1.679s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-3a6165e6-23da-465f-966f-4232670bce07" returned: 0 in 0.653s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] Lock "cinder-quobyte-3a6165e6-23da-465f-966f-4232670bce07" released by "delete_volume" :: held 1.620s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] Created reservations ['5f142669-b0f4-43b3-aff4-7d835dbab3df', '2ca44106-5a88-4985-b836-e847e1502056', '45d955df-d3dd-48f3-8158-edec8273e769', '7b5e8f09-b237-4eb1-abc6-b94cc815514c'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] Created reservations ['e4f869e4-28f8-4e72-9fe0-23187bec0526', 'fbfdc4ca-5dd7-4351-94f1-593186be67c5', '3bc0e39b-9323-4465-b1e9-31d7654e0f5c', '4d83833e-371b-416a-8686-c69e0f952edb'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:02 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:23:02 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:02 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:23:02 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:03 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.898s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:23:03 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] Deleted volume successfully. Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-600d771e-c0b6-473c-812e-b5e9af6ce558 tempest-VolumesTransfersV355Test-1550252003 None] Lock "cinder-3a6165e6-23da-465f-966f-4232670bce07-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:03 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.040s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:23:03 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] Deleted volume successfully. Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0e937cfa-d3bf-4c3a-9d65-6be353794263 tempest-VolumesActionsTest-1679402068 None] Lock "cinder-77967f4b-02cf-47ff-ae74-3a1109a303fc-delete_volume" released by "delete_volume" :: held 3.085s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Flow 'volume_create_manager' (653cc1e4-d549-455e-b92e-81029868eaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85adaf9e-9332-439a-9f0f-6cfcc3abc3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85adaf9e-9332-439a-9f0f-6cfcc3abc3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2135703389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd96c38-c5a1-4172-8d87-961b77048c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3996e24e7b214c8baa1c18dfd756f79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:04Z,use_quota=True,user_id='d61b724ae828467980f7e726b586d6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9c20b3-73f4-49d3-adcc-90f856651221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9c20b3-73f4-49d3-adcc-90f856651221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0e5e18-8dc5-4ed7-8836-7e4debb176a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0e5e18-8dc5-4ed7-8836-7e4debb176a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbd96c38-c5a1-4172-8d87-961b77048c47', 'volume_name': 'volume-dbd96c38-c5a1-4172-8d87-961b77048c47', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683a76f1-30df-44a3-ba3e-2bd2dd05548c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683a76f1-30df-44a3-ba3e-2bd2dd05548c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0ff21d-b781-4d04-925b-a1930b5823a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:03 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Volume dbd96c38-c5a1-4172-8d87-961b77048c47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbd96c38-c5a1-4172-8d87-961b77048c47', 'volume_size': 1} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2135703389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd96c38-c5a1-4172-8d87-961b77048c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3996e24e7b214c8baa1c18dfd756f79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:04Z,use_quota=True,user_id='d61b724ae828467980f7e726b586d6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Creating volume dbd96c38-c5a1-4172-8d87-961b77048c47 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:23:03 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dbd96c38-c5a1-4172-8d87-961b77048c47 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:23:03 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dbd96c38-c5a1-4172-8d87-961b77048c47 1073741824 Jun 15 07:23:03 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Flow 'volume_create_manager' (140e81b5-1be4-4100-b199-238ad7f1ff9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76a4d21-0bbc-4d1d-91a9-63f39a08b36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76a4d21-0bbc-4d1d-91a9-63f39a08b36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-923895941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2295924f-86bc-48c4-a23c-75e549968329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f396b05fa1d4245b5adbfe1847901fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:04Z,use_quota=True,user_id='b930941ebc604e0bbb0cea0064a0bbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85fca84-c0fd-40cc-8597-d7ea42dee7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85fca84-c0fd-40cc-8597-d7ea42dee7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7dba6c-c698-4cc9-a0cf-4f41ae3a3dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7dba6c-c698-4cc9-a0cf-4f41ae3a3dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2295924f-86bc-48c4-a23c-75e549968329', 'volume_name': 'volume-2295924f-86bc-48c4-a23c-75e549968329', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f665592-184d-4d71-a84a-88a497133a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f665592-184d-4d71-a84a-88a497133a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa632f3-06ab-483d-a163-65c4410855b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:03 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Volume 2295924f-86bc-48c4-a23c-75e549968329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2295924f-86bc-48c4-a23c-75e549968329', 'volume_size': 1} Jun 15 07:23:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:04 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dbd96c38-c5a1-4172-8d87-961b77048c47 1073741824" returned: 0 in 0.976s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dbd96c38-c5a1-4172-8d87-961b77048c47 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:04 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dbd96c38-c5a1-4172-8d87-961b77048c47 Jun 15 07:23:04 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:05 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dbd96c38-c5a1-4172-8d87-961b77048c47" returned: 0 in 0.887s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:23:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.770s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-923895941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2295924f-86bc-48c4-a23c-75e549968329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f396b05fa1d4245b5adbfe1847901fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:04Z,use_quota=True,user_id='b930941ebc604e0bbb0cea0064a0bbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:23:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Creating volume 2295924f-86bc-48c4-a23c-75e549968329 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:23:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:23:05 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:23:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2295924f-86bc-48c4-a23c-75e549968329 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:05 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0ff21d-b781-4d04-925b-a1930b5823a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbd96c38-c5a1-4172-8d87-961b77048c47', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:05 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2295924f-86bc-48c4-a23c-75e549968329 1073741824 Jun 15 07:23:05 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:05 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b0c0161-e8a8-46bd-be0e-595f18451b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:05 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Volume volume-dbd96c38-c5a1-4172-8d87-961b77048c47 (dbd96c38-c5a1-4172-8d87-961b77048c47): created successfully Jun 15 07:23:05 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b0c0161-e8a8-46bd-be0e-595f18451b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:05 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Flow 'volume_create_manager' (653cc1e4-d549-455e-b92e-81029868eaaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:05 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-af5be550-ea67-47d5-ad80-96b43e9d2d84 tempest-VolumesTransfersV355Test-651884003 None] Created volume successfully. Jun 15 07:23:07 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2295924f-86bc-48c4-a23c-75e549968329 1073741824" returned: 0 in 1.313s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2295924f-86bc-48c4-a23c-75e549968329 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:07 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2295924f-86bc-48c4-a23c-75e549968329 Jun 15 07:23:07 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] Acquiring lock "cinder-dbd96c38-c5a1-4172-8d87-961b77048c47-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:07 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-ec94af55-e5a3-4d8c-ac65-69f0da7cfa8a tempest-GroupsV320Test-2055715168 None] Group tempest-GroupsV320Test-Group-2015764927: creating Jun 15 07:23:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] Lock "cinder-dbd96c38-c5a1-4172-8d87-961b77048c47-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:07 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-ec94af55-e5a3-4d8c-ac65-69f0da7cfa8a tempest-GroupsV320Test-2055715168 None] Group tempest-GroupsV320Test-Group-2015764927: created successfully Jun 15 07:23:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] Acquiring lock "cinder-quobyte-dbd96c38-c5a1-4172-8d87-961b77048c47" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:07 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-ec94af55-e5a3-4d8c-ac65-69f0da7cfa8a tempest-GroupsV320Test-2055715168 None] Create group completed successfully. Jun 15 07:23:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] Lock "cinder-quobyte-dbd96c38-c5a1-4172-8d87-961b77048c47" acquired by "delete_volume" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:07 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2412f5da-dcdc-4815-80af-bef237120c33]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dbd96c38-c5a1-4172-8d87-961b77048c47 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:07 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dbd96c38-c5a1-4172-8d87-961b77048c47 Jun 15 07:23:07 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:08 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2295924f-86bc-48c4-a23c-75e549968329" returned: 0 in 0.884s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] <== create_volume: return (2268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:23:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.273s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa632f3-06ab-483d-a163-65c4410855b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2295924f-86bc-48c4-a23c-75e549968329', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15571fa1-32ef-40e3-b0d7-a956a2b5888e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:08 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Volume volume-2295924f-86bc-48c4-a23c-75e549968329 (2295924f-86bc-48c4-a23c-75e549968329): created successfully Jun 15 07:23:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15571fa1-32ef-40e3-b0d7-a956a2b5888e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Flow 'volume_create_manager' (140e81b5-1be4-4100-b199-238ad7f1ff9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:08 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-defbe3a3-e1e5-469b-b6cc-68cac2078fea tempest-VolumesActionsTest-444549829 None] Created volume successfully. Jun 15 07:23:08 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dbd96c38-c5a1-4172-8d87-961b77048c47" returned: 0 in 0.870s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dbd96c38-c5a1-4172-8d87-961b77048c47 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:08 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dbd96c38-c5a1-4172-8d87-961b77048c47 Jun 15 07:23:08 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-863dc66e-1532-4d6f-8f91-368c217bf294 tempest-GroupsV320Test-2055715168 None] Created reservations ['18b2454a-7ce7-473c-a089-e63726d65f7d'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-863dc66e-1532-4d6f-8f91-368c217bf294 tempest-GroupsV320Test-2055715168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-863dc66e-1532-4d6f-8f91-368c217bf294 tempest-GroupsV320Test-2055715168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-863dc66e-1532-4d6f-8f91-368c217bf294 tempest-GroupsV320Test-2055715168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-863dc66e-1532-4d6f-8f91-368c217bf294 tempest-GroupsV320Test-2055715168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-863dc66e-1532-4d6f-8f91-368c217bf294 tempest-GroupsV320Test-2055715168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-863dc66e-1532-4d6f-8f91-368c217bf294 tempest-GroupsV320Test-2055715168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:09 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:23:09 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:09 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dbd96c38-c5a1-4172-8d87-961b77048c47" returned: 0 in 0.775s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] Lock "cinder-quobyte-dbd96c38-c5a1-4172-8d87-961b77048c47" released by "delete_volume" :: held 1.702s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] Acquiring lock "cinder-2295924f-86bc-48c4-a23c-75e549968329-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] Created reservations ['25bf28c9-1179-44aa-9f19-c9158fc996a1', '296bcce4-10a1-41c0-af96-11de6ba19820', '0f8a47c1-68f4-48ed-b649-e325fd9f4211', '2ec4c6a9-8edd-4428-a54c-4efbf3f5370a'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] Lock "cinder-2295924f-86bc-48c4-a23c-75e549968329-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] Acquiring lock "cinder-quobyte-2295924f-86bc-48c4-a23c-75e549968329" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] Lock "cinder-quobyte-2295924f-86bc-48c4-a23c-75e549968329" acquired by "delete_volume" :: waited 0.047s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[255480fc-51bd-45ac-bf49-c6338e292d53]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2295924f-86bc-48c4-a23c-75e549968329 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:09 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:23:09 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:09 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2295924f-86bc-48c4-a23c-75e549968329 Jun 15 07:23:09 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:10 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-863dc66e-1532-4d6f-8f91-368c217bf294 tempest-GroupsV320Test-2055715168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.925s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:10 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-863dc66e-1532-4d6f-8f91-368c217bf294 tempest-GroupsV320Test-2055715168 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:23:10 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-863dc66e-1532-4d6f-8f91-368c217bf294 tempest-GroupsV320Test-2055715168 None] Delete group completed successfully. Jun 15 07:23:10 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.078s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:10 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:23:10 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] Deleted volume successfully. Jun 15 07:23:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bd40b899-c72f-4458-a3c7-3df53be5fbde tempest-VolumesTransfersV355Test-1550252003 None] Lock "cinder-dbd96c38-c5a1-4172-8d87-961b77048c47-delete_volume" released by "delete_volume" :: held 3.204s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:10 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2295924f-86bc-48c4-a23c-75e549968329" returned: 0 in 1.231s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2295924f-86bc-48c4-a23c-75e549968329 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:10 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2295924f-86bc-48c4-a23c-75e549968329 Jun 15 07:23:10 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:11 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2295924f-86bc-48c4-a23c-75e549968329" returned: 0 in 0.790s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:11 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] Lock "cinder-quobyte-2295924f-86bc-48c4-a23c-75e549968329" released by "delete_volume" :: held 2.099s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:11 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] Created reservations ['79158e6f-fee6-4ebe-892e-68d9c46a1a8b', '530375ba-1c4a-42a2-aedf-bd8335f09116', '4c2d0500-1f6d-445c-b6d3-5663e876f401', 'e882d641-24d4-4146-9f79-5b482e90e11a'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:23:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:11 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:23:11 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:12 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.829s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:12 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:23:12 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] Deleted volume successfully. Jun 15 07:23:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-976a930a-0a6d-4015-ae54-2afcd57f2c1c tempest-VolumesActionsTest-1679402068 None] Lock "cinder-2295924f-86bc-48c4-a23c-75e549968329-delete_volume" released by "delete_volume" :: held 3.324s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Flow 'volume_create_manager' (61b869f6-bdd4-4fdb-bbd8-888483fd06b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c2bb81-37f8-45fc-8481-e08aca87e4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c2bb81-37f8-45fc-8481-e08aca87e4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1910976601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88458da7-4cdb-47da-81e5-549a531cd345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f396b05fa1d4245b5adbfe1847901fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:14Z,use_quota=True,user_id='b930941ebc604e0bbb0cea0064a0bbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4e29cb-4f2b-40cb-971e-6b6d9836de19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4e29cb-4f2b-40cb-971e-6b6d9836de19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd55e94c-2edf-4f96-b7bf-b27a8adad383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd55e94c-2edf-4f96-b7bf-b27a8adad383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88458da7-4cdb-47da-81e5-549a531cd345', 'volume_name': 'volume-88458da7-4cdb-47da-81e5-549a531cd345', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8794e7f-7110-49c2-b99b-3b20f93a2d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8794e7f-7110-49c2-b99b-3b20f93a2d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541124a1-a335-47a4-a9bc-1e0e35f0a343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:13 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Volume 88458da7-4cdb-47da-81e5-549a531cd345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88458da7-4cdb-47da-81e5-549a531cd345', 'volume_size': 1} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1910976601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88458da7-4cdb-47da-81e5-549a531cd345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f396b05fa1d4245b5adbfe1847901fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:14Z,use_quota=True,user_id='b930941ebc604e0bbb0cea0064a0bbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Creating volume 88458da7-4cdb-47da-81e5-549a531cd345 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:23:13 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-88458da7-4cdb-47da-81e5-549a531cd345 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:13 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-88458da7-4cdb-47da-81e5-549a531cd345 1073741824 Jun 15 07:23:13 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:14 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:23:14 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:14 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.989s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:14 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:23:14 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:23:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 8 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:23:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:23:15 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-88458da7-4cdb-47da-81e5-549a531cd345 1073741824" returned: 0 in 1.374s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-88458da7-4cdb-47da-81e5-549a531cd345 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:15 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-88458da7-4cdb-47da-81e5-549a531cd345 Jun 15 07:23:15 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:16 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-88458da7-4cdb-47da-81e5-549a531cd345" returned: 0 in 0.853s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] <== create_volume: return (2287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:23:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541124a1-a335-47a4-a9bc-1e0e35f0a343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88458da7-4cdb-47da-81e5-549a531cd345', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95197b12-4a5f-4526-81a1-678e6c741af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:16 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Volume volume-88458da7-4cdb-47da-81e5-549a531cd345 (88458da7-4cdb-47da-81e5-549a531cd345): created successfully Jun 15 07:23:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95197b12-4a5f-4526-81a1-678e6c741af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Flow 'volume_create_manager' (61b869f6-bdd4-4fdb-bbd8-888483fd06b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:16 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-480c31bf-6181-46e4-9459-91c0174937ff tempest-VolumesActionsTest-444549829 None] Created volume successfully. Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] Acquiring lock "cinder-88458da7-4cdb-47da-81e5-549a531cd345-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] Lock "cinder-88458da7-4cdb-47da-81e5-549a531cd345-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] Acquiring lock "cinder-quobyte-88458da7-4cdb-47da-81e5-549a531cd345" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] Lock "cinder-quobyte-88458da7-4cdb-47da-81e5-549a531cd345" acquired by "delete_volume" :: waited 0.026s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa73a996-4195-47c6-a520-392a32e7408b]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-88458da7-4cdb-47da-81e5-549a531cd345 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:17 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-88458da7-4cdb-47da-81e5-549a531cd345 Jun 15 07:23:17 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Flow 'volume_create_manager' (94587b31-5fa5-4133-bd6f-0b718b65c33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8c7db3-041e-4b91-ab47-102d02752a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8c7db3-041e-4b91-ab47-102d02752a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1052463120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca0d51b-3635-43c0-bd64-1ad4968353e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ed95802f7e4e22ac4a1d5af830ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:18Z,use_quota=True,user_id='7b694f7fbe9241788cdd379277f0e6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad58b2be-9389-4676-90b4-16f6346ef5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad58b2be-9389-4676-90b4-16f6346ef5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3bc656-1e07-45d4-9ef8-5d893fd1af9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3bc656-1e07-45d4-9ef8-5d893fd1af9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca0d51b-3635-43c0-bd64-1ad4968353e1', 'volume_name': 'volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf25ada2-b5af-464a-89e5-42aa161e28cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf25ada2-b5af-464a-89e5-42aa161e28cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c30db3b-e4f9-4ef7-84b9-68be2c143e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:17 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Volume 6ca0d51b-3635-43c0-bd64-1ad4968353e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1', 'volume_size': 1} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1052463120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca0d51b-3635-43c0-bd64-1ad4968353e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ed95802f7e4e22ac4a1d5af830ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:18Z,use_quota=True,user_id='7b694f7fbe9241788cdd379277f0e6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Creating volume 6ca0d51b-3635-43c0-bd64-1ad4968353e1 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:23:17 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:23:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:17 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 1073741824 Jun 15 07:23:17 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:18 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-88458da7-4cdb-47da-81e5-549a531cd345" returned: 0 in 1.128s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-88458da7-4cdb-47da-81e5-549a531cd345 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:18 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-88458da7-4cdb-47da-81e5-549a531cd345 Jun 15 07:23:18 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:19 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 1073741824" returned: 0 in 1.045s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:19 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 Jun 15 07:23:19 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:19 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-88458da7-4cdb-47da-81e5-549a531cd345" returned: 0 in 0.785s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] Lock "cinder-quobyte-88458da7-4cdb-47da-81e5-549a531cd345" released by "delete_volume" :: held 1.970s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] Created reservations ['caec2ba2-c4ed-4cbc-a7ca-1030dd901684', 'a58c8683-e3a5-4b0b-a72f-32596028188f', '6b98408b-aae8-497f-81f1-89be1c081237', 'bddec52c-fd36-4849-8546-421136c3c5c0'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:19 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:23:19 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:19 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1" returned: 0 in 0.847s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c30db3b-e4f9-4ef7-84b9-68be2c143e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c61843a-4ddc-4473-a237-f215fa937ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:19 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Volume volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 (6ca0d51b-3635-43c0-bd64-1ad4968353e1): created successfully Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c61843a-4ddc-4473-a237-f215fa937ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Flow 'volume_create_manager' (94587b31-5fa5-4133-bd6f-0b718b65c33d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:19 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-409c04bf-f6e1-43f1-b345-bc9f5fb8cb49 tempest-VolumesCloneTest-939341732 None] Created volume successfully. Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Flow 'volume_create_manager' (96b8a2e1-c7ce-4b21-8fbb-b44c74dc98d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d427a331-e37c-44c6-b94a-d68198496c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:20 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.837s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:23:20 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] Deleted volume successfully. Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d427a331-e37c-44c6-b94a-d68198496c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-297089567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcf39d9-c29b-49b4-874a-39e3ca84f055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f396b05fa1d4245b5adbfe1847901fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:20Z,use_quota=True,user_id='b930941ebc604e0bbb0cea0064a0bbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc7465b-b0b4-482d-919c-e5143a30f3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc7465b-b0b4-482d-919c-e5143a30f3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876eca9b-fad7-4d09-afd0-e4460f23f2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876eca9b-fad7-4d09-afd0-e4460f23f2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dcf39d9-c29b-49b4-874a-39e3ca84f055', 'volume_name': 'volume-5dcf39d9-c29b-49b4-874a-39e3ca84f055', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719f0738-f663-44fc-a6d4-f76e3f4b61b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719f0738-f663-44fc-a6d4-f76e3f4b61b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d35a2f-29bd-464b-be7d-570211d12a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:20 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Volume 5dcf39d9-c29b-49b4-874a-39e3ca84f055: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dcf39d9-c29b-49b4-874a-39e3ca84f055', 'volume_size': 1} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-297089567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcf39d9-c29b-49b4-874a-39e3ca84f055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f396b05fa1d4245b5adbfe1847901fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:20Z,use_quota=True,user_id='b930941ebc604e0bbb0cea0064a0bbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Creating volume 5dcf39d9-c29b-49b4-874a-39e3ca84f055 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:23:20 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5dcf39d9-c29b-49b4-874a-39e3ca84f055 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-265cfee2-d55b-4799-a86a-fda6bd299cae tempest-VolumesActionsTest-1679402068 None] Lock "cinder-88458da7-4cdb-47da-81e5-549a531cd345-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:20 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5dcf39d9-c29b-49b4-874a-39e3ca84f055 1073741824 Jun 15 07:23:20 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:21 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5dcf39d9-c29b-49b4-874a-39e3ca84f055 1073741824" returned: 0 in 0.963s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:21 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=127,cinder:UPDATE=119,cinder:INSERT=34,cinder:DELETE=6 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:23:21 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=113,cinder:INSERT=31,cinder:UPDATE=154,cinder:DELETE=11 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:23:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5dcf39d9-c29b-49b4-874a-39e3ca84f055 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:21 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5dcf39d9-c29b-49b4-874a-39e3ca84f055 Jun 15 07:23:21 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:21 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:23:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Flow 'volume_create_manager' (84a048b6-be31-41a1-a85f-402626160385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59373aa-68ba-4100-944b-5f9c533b90ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59373aa-68ba-4100-944b-5f9c533b90ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-10849895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51241395-b6a0-4cf1-bfa5-cd8631954a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ed95802f7e4e22ac4a1d5af830ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6ca0d51b-3635-43c0-bd64-1ad4968353e1,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:21Z,use_quota=True,user_id='7b694f7fbe9241788cdd379277f0e6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c746ae3-840f-4315-848b-6559d7542631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c746ae3-840f-4315-848b-6559d7542631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac47023-a175-431b-9235-e07191838360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac47023-a175-431b-9235-e07191838360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '51241395-b6a0-4cf1-bfa5-cd8631954a8a', 'volume_name': 'volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a', 'volume_size': 2, 'source_volid': '6ca0d51b-3635-43c0-bd64-1ad4968353e1', 'source_volstatus': 'available'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025b3b2a-dee2-41ca-960b-09c9e7c7b06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025b3b2a-dee2-41ca-960b-09c9e7c7b06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1dd734-f90a-48bf-8e52-731732bc5522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:21 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Volume 51241395-b6a0-4cf1-bfa5-cd8631954a8a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a', 'volume_size': 2, 'source_volid': '6ca0d51b-3635-43c0-bd64-1ad4968353e1', 'source_volstatus': 'available'} Jun 15 07:23:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:22 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5dcf39d9-c29b-49b4-874a-39e3ca84f055" returned: 0 in 0.621s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:22 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:23:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.471s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:22 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Cloning volume 6ca0d51b-3635-43c0-bd64-1ad4968353e1 to volume 51241395-b6a0-4cf1-bfa5-cd8631954a8a Jun 15 07:23:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d35a2f-29bd-464b-be7d-570211d12a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dcf39d9-c29b-49b4-874a-39e3ca84f055', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e4a0ff-42d5-48a8-946e-13acabdf40d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:22 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Volume volume-5dcf39d9-c29b-49b4-874a-39e3ca84f055 (5dcf39d9-c29b-49b4-874a-39e3ca84f055): created successfully Jun 15 07:23:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e4a0ff-42d5-48a8-946e-13acabdf40d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Flow 'volume_create_manager' (96b8a2e1-c7ce-4b21-8fbb-b44c74dc98d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:22 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Creating offline snapshot e87c2f91-7550-4e61-a1e4-f968bcda2431 of volume 6ca0d51b-3635-43c0-bd64-1ad4968353e1 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:23:22 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c2193251-160a-4da9-8383-921f254885e0 tempest-VolumesActionsTest-444549829 None] Created volume successfully. Jun 15 07:23:22 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1a464e-4244-4c52-bc3b-721bc7ddfab3]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:22 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 Jun 15 07:23:22 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] Acquiring lock "cinder-5dcf39d9-c29b-49b4-874a-39e3ca84f055-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] Lock "cinder-5dcf39d9-c29b-49b4-874a-39e3ca84f055-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] Acquiring lock "cinder-quobyte-5dcf39d9-c29b-49b4-874a-39e3ca84f055" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] Lock "cinder-quobyte-5dcf39d9-c29b-49b4-874a-39e3ca84f055" acquired by "delete_volume" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:22 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[576f9016-d71c-46b0-9a16-4703763782c5]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5dcf39d9-c29b-49b4-874a-39e3ca84f055 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:22 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5dcf39d9-c29b-49b4-874a-39e3ca84f055 Jun 15 07:23:22 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:23 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1" returned: 0 in 0.863s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:23 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431 1G Jun 15 07:23:23 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:23 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5dcf39d9-c29b-49b4-874a-39e3ca84f055" returned: 0 in 0.780s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5dcf39d9-c29b-49b4-874a-39e3ca84f055 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:23 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5dcf39d9-c29b-49b4-874a-39e3ca84f055 Jun 15 07:23:23 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:23 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431 1G" returned: 0 in 0.893s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:24 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431 Jun 15 07:23:24 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:24 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5dcf39d9-c29b-49b4-874a-39e3ca84f055" returned: 0 in 0.720s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] Lock "cinder-quobyte-5dcf39d9-c29b-49b4-874a-39e3ca84f055" released by "delete_volume" :: held 1.553s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:24 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] Created reservations ['78f0df54-e786-4cd5-bcc3-7e8826a525b3', '29c85b07-7335-4f55-b8f5-bf6ce3c7844a', 'ecfd9026-1dd9-4bb0-bd3d-8c283cfe70c4', '8acbdab1-38c1-402c-b622-ec8ccc98d625'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:23:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:24 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:23:24 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:24 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431" returned: 0 in 0.657s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:24 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431 is being set with open permissions: ugo+rw Jun 15 07:23:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:24 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431 Jun 15 07:23:24 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:25 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.737s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:25 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:23:25 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] Deleted volume successfully. Jun 15 07:23:25 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e7df56e2-a2f3-4ac0-ba27-280fd07766ee tempest-VolumesActionsTest-1679402068 None] Lock "cinder-5dcf39d9-c29b-49b4-874a-39e3ca84f055-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:25 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431" returned: 0 in 0.653s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:25 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.info Jun 15 07:23:25 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:25 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:23:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Flow 'volume_create_manager' (34f0a82d-692b-4d1f-b501-843b56a38c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f66d70f-d878-4f1e-a353-29be9a8e426a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f66d70f-d878-4f1e-a353-29be9a8e426a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1974252593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f007d4-f7ba-4caa-8756-4080bfe68054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f396b05fa1d4245b5adbfe1847901fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:25Z,use_quota=True,user_id='b930941ebc604e0bbb0cea0064a0bbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec1f70f-0067-4974-bf8a-7f60fcfb5361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec1f70f-0067-4974-bf8a-7f60fcfb5361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5ea21b-baed-4c21-b110-94fd306f2b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5ea21b-baed-4c21-b110-94fd306f2b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03f007d4-f7ba-4caa-8756-4080bfe68054', 'volume_name': 'volume-03f007d4-f7ba-4caa-8756-4080bfe68054', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f91ad79-5889-44c9-b7a9-0a1b16b5bda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f91ad79-5889-44c9-b7a9-0a1b16b5bda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88304a0-4eda-4217-b246-a8ac14b66340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:25 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Volume 03f007d4-f7ba-4caa-8756-4080bfe68054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03f007d4-f7ba-4caa-8756-4080bfe68054', 'volume_size': 1} Jun 15 07:23:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:26 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.info" returned: 0 in 0.743s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:26 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.info is being set with open permissions: ugo+rw Jun 15 07:23:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:26 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.info Jun 15 07:23:26 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:26 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.info" returned: 0 in 0.694s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Acquiring lock "cinder-quobyte-51241395-b6a0-4cf1-bfa5-cd8631954a8a" by "_copy_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Lock "cinder-quobyte-51241395-b6a0-4cf1-bfa5-cd8631954a8a" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] snapshot: e87c2f91-7550-4e61-a1e4-f968bcda2431, volume: 51241395-b6a0-4cf1-bfa5-cd8631954a8a, {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:23:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:26 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdd0765-4522-4e84-ba53-e37c4c18ea67]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:27 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431 Jun 15 07:23:27 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:27 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431" returned: 0 in 0.775s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:23:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:23:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Creating direct copy from snapshot {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:23:27 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e24169-1d56-4ff0-9ac5-40abfeda8e40]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:27 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 Jun 15 07:23:27 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:28 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1" returned: 0 in 0.762s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:28 devstack cinder-volume[92129]: DEBUG cinder.utils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Path /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a not found in is_blk_device check {{(pid=92129) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:23:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:28 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a Jun 15 07:23:28 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:32 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:23:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Flow 'volume_create_manager' (298279ca-62d0-4b8c-82d4-d8ccf62883fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f625ebe3-62af-4d90-987d-49b168a85c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f625ebe3-62af-4d90-987d-49b168a85c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1453634355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd93bb6d-727e-45e1-87bc-e2280744005c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc55d06840ed412fa416dab1ebff9b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:33Z,use_quota=True,user_id='0582411c067d440d8418f5a3b2d9a3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cead5ef-df5a-40c1-b911-ef3b85bbc83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cead5ef-df5a-40c1-b911-ef3b85bbc83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ca1d39-38c5-4cd1-bf80-903912a22233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ca1d39-38c5-4cd1-bf80-903912a22233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd93bb6d-727e-45e1-87bc-e2280744005c', 'volume_name': 'volume-dd93bb6d-727e-45e1-87bc-e2280744005c', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2176cb09-794f-4189-9d09-2da44f4eb749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2176cb09-794f-4189-9d09-2da44f4eb749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6dd390-c7da-46c2-b5de-4f1299bd9b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:33 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Volume dd93bb6d-727e-45e1-87bc-e2280744005c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd93bb6d-727e-45e1-87bc-e2280744005c', 'volume_size': 1} Jun 15 07:23:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:34 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a" returned: 0 in 6.419s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:34 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f579c9-ba47-425f-83c7-8bfeb56fe0bb]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:35 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 Jun 15 07:23:35 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:35 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1" returned: 0 in 0.851s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:35 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Image conversion details: src /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1, size 1024.00 MB, duration 6.42 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:23:35 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Converted 1024.00 MB image at 159.51 MB/s Jun 15 07:23:35 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a is being set with open permissions: ugo+rw Jun 15 07:23:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:35 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a Jun 15 07:23:35 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:36 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a" returned: 0 in 0.592s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Lock "cinder-quobyte-51241395-b6a0-4cf1-bfa5-cd8631954a8a" released by "_copy_volume_from_snapshot" :: held 9.527s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Acquiring lock "cinder-quobyte-e87c2f91-7550-4e61-a1e4-f968bcda2431" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Lock "cinder-quobyte-e87c2f91-7550-4e61-a1e4-f968bcda2431" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Deleting offline snapshot e87c2f91-7550-4e61-a1e4-f968bcda2431 of volume 6ca0d51b-3635-43c0-bd64-1ad4968353e1 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:23:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] snapshot_file for this snap is: volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:23:36 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6bb4da-6207-4130-995e-c145ee98ad37]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:36 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431 Jun 15 07:23:36 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:37 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431" returned: 0 in 0.751s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:23:37 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ee62d7-a74a-4b3c-98e9-37edf533af9c]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:37 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 Jun 15 07:23:37 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:37 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1" returned: 0 in 0.704s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:37 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431 Jun 15 07:23:37 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:38 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431" returned: 0 in 0.659s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:38 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431 Jun 15 07:23:38 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:39 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1.e87c2f91-7550-4e61-a1e4-f968bcda2431" returned: 0 in 0.575s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Lock "cinder-quobyte-e87c2f91-7550-4e61-a1e4-f968bcda2431" released by "_delete_snapshot" :: held 2.780s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.092s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.587s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1974252593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f007d4-f7ba-4caa-8756-4080bfe68054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f396b05fa1d4245b5adbfe1847901fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:25Z,use_quota=True,user_id='b930941ebc604e0bbb0cea0064a0bbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:23:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Creating volume 03f007d4-f7ba-4caa-8756-4080bfe68054 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:23:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:23:39 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:23:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-03f007d4-f7ba-4caa-8756-4080bfe68054 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1dd734-f90a-48bf-8e52-731732bc5522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a', 'volume_size': 2, 'source_volid': '6ca0d51b-3635-43c0-bd64-1ad4968353e1', 'source_volstatus': 'available'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:39 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-03f007d4-f7ba-4caa-8756-4080bfe68054 1073741824 Jun 15 07:23:39 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b65199-00bc-401d-b9af-49389fbb4b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:39 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Volume volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a (51241395-b6a0-4cf1-bfa5-cd8631954a8a): created successfully Jun 15 07:23:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b65199-00bc-401d-b9af-49389fbb4b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Flow 'volume_create_manager' (84a048b6-be31-41a1-a85f-402626160385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:39 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-151480a6-c679-4703-9380-8146f7ca13e9 tempest-VolumesCloneTest-939341732 None] Created volume successfully. Jun 15 07:23:40 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-03f007d4-f7ba-4caa-8756-4080bfe68054 1073741824" returned: 0 in 0.829s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-03f007d4-f7ba-4caa-8756-4080bfe68054 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:40 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-03f007d4-f7ba-4caa-8756-4080bfe68054 Jun 15 07:23:40 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] Acquiring lock "cinder-51241395-b6a0-4cf1-bfa5-cd8631954a8a-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] Lock "cinder-51241395-b6a0-4cf1-bfa5-cd8631954a8a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] Acquiring lock "cinder-quobyte-51241395-b6a0-4cf1-bfa5-cd8631954a8a" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] Lock "cinder-quobyte-51241395-b6a0-4cf1-bfa5-cd8631954a8a" acquired by "delete_volume" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[381406e1-9a24-4861-9959-744e8f0e1289]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:40 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a Jun 15 07:23:40 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:40 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-03f007d4-f7ba-4caa-8756-4080bfe68054" returned: 0 in 0.655s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.604s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1453634355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd93bb6d-727e-45e1-87bc-e2280744005c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc55d06840ed412fa416dab1ebff9b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:33Z,use_quota=True,user_id='0582411c067d440d8418f5a3b2d9a3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Creating volume dd93bb6d-727e-45e1-87bc-e2280744005c {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:23:40 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dd93bb6d-727e-45e1-87bc-e2280744005c 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:40 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dd93bb6d-727e-45e1-87bc-e2280744005c 1073741824 Jun 15 07:23:40 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88304a0-4eda-4217-b246-a8ac14b66340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f007d4-f7ba-4caa-8756-4080bfe68054', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3138a4-79e3-4111-ab71-f80bce03071f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:40 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Volume volume-03f007d4-f7ba-4caa-8756-4080bfe68054 (03f007d4-f7ba-4caa-8756-4080bfe68054): created successfully Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3138a4-79e3-4111-ab71-f80bce03071f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Flow 'volume_create_manager' (34f0a82d-692b-4d1f-b501-843b56a38c0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:40 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-71343146-98c9-4fd9-8314-0ab76ce14c39 tempest-VolumesActionsTest-444549829 None] Created volume successfully. Jun 15 07:23:41 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a" returned: 0 in 1.014s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:41 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a Jun 15 07:23:41 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:41 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dd93bb6d-727e-45e1-87bc-e2280744005c 1073741824" returned: 0 in 1.005s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dd93bb6d-727e-45e1-87bc-e2280744005c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:41 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dd93bb6d-727e-45e1-87bc-e2280744005c Jun 15 07:23:41 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] Acquiring lock "cinder-03f007d4-f7ba-4caa-8756-4080bfe68054-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] Lock "cinder-03f007d4-f7ba-4caa-8756-4080bfe68054-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] Acquiring lock "cinder-quobyte-03f007d4-f7ba-4caa-8756-4080bfe68054" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] Lock "cinder-quobyte-03f007d4-f7ba-4caa-8756-4080bfe68054" acquired by "delete_volume" :: waited 0.031s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb479bd5-aa60-470e-b951-846f163ab06b]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-03f007d4-f7ba-4caa-8756-4080bfe68054 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:42 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-03f007d4-f7ba-4caa-8756-4080bfe68054 Jun 15 07:23:42 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:42 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-51241395-b6a0-4cf1-bfa5-cd8631954a8a" returned: 0 in 0.776s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] Lock "cinder-quobyte-51241395-b6a0-4cf1-bfa5-cd8631954a8a" released by "delete_volume" :: held 1.873s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] Created reservations ['0691bf0b-80f8-4d39-93cf-91af018593bb', 'df87ab8d-2938-43ce-89e8-d7cd9c545a48', '195e44a8-1bd0-4d26-8cda-fd76beff0cb8', '9a80900b-bffb-4057-914a-730462738cfc'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:42 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:23:42 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:42 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dd93bb6d-727e-45e1-87bc-e2280744005c" returned: 0 in 0.789s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6dd390-c7da-46c2-b5de-4f1299bd9b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd93bb6d-727e-45e1-87bc-e2280744005c', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe60a93-e525-42be-92f3-d645da79c2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:42 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Volume volume-dd93bb6d-727e-45e1-87bc-e2280744005c (dd93bb6d-727e-45e1-87bc-e2280744005c): created successfully Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe60a93-e525-42be-92f3-d645da79c2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Flow 'volume_create_manager' (298279ca-62d0-4b8c-82d4-d8ccf62883fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:42 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f2d149e8-d07d-4e0e-b0d4-eb03fe856cf3 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Created volume successfully. Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] Acquiring lock "cinder-6ca0d51b-3635-43c0-bd64-1ad4968353e1-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] Lock "cinder-6ca0d51b-3635-43c0-bd64-1ad4968353e1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] Acquiring lock "cinder-quobyte-6ca0d51b-3635-43c0-bd64-1ad4968353e1" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] Lock "cinder-quobyte-6ca0d51b-3635-43c0-bd64-1ad4968353e1" acquired by "delete_volume" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:43 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e7c8ad-3fbc-4d49-a521-81450b71313f]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:43 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-03f007d4-f7ba-4caa-8756-4080bfe68054" returned: 0 in 1.072s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-03f007d4-f7ba-4caa-8756-4080bfe68054 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:43 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 Jun 15 07:23:43 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:43 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-03f007d4-f7ba-4caa-8756-4080bfe68054 Jun 15 07:23:43 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:43 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.831s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:43 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:23:43 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] Deleted volume successfully. Jun 15 07:23:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-204fe0b5-42e5-4977-a150-fde0575a71c8 tempest-VolumesCloneTest-939341732 None] Lock "cinder-51241395-b6a0-4cf1-bfa5-cd8631954a8a-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:43 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1" returned: 0 in 0.843s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:43 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-03f007d4-f7ba-4caa-8756-4080bfe68054" returned: 0 in 0.735s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:43 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1 Jun 15 07:23:43 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] Lock "cinder-quobyte-03f007d4-f7ba-4caa-8756-4080bfe68054" released by "delete_volume" :: held 1.874s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Acquiring lock "cinder-dd93bb6d-727e-45e1-87bc-e2280744005c-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Lock "cinder-dd93bb6d-727e-45e1-87bc-e2280744005c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] Created reservations ['80368bd2-2875-4b6e-a377-768da33c6069', '70e2a5e5-9c54-4aab-b762-db2130608b1b', '5e512532-ed13-4f54-94a2-9a1133294915', '204b1a85-1236-47f0-99a5-185b78a916e9'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Acquiring lock "cinder-quobyte-dd93bb6d-727e-45e1-87bc-e2280744005c" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Lock "cinder-quobyte-dd93bb6d-727e-45e1-87bc-e2280744005c" acquired by "delete_volume" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1081ba9-2178-4537-a086-92083d9cd951]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dd93bb6d-727e-45e1-87bc-e2280744005c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:44 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:23:44 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:44 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dd93bb6d-727e-45e1-87bc-e2280744005c Jun 15 07:23:44 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:44 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ca0d51b-3635-43c0-bd64-1ad4968353e1" returned: 0 in 0.838s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] Lock "cinder-quobyte-6ca0d51b-3635-43c0-bd64-1ad4968353e1" released by "delete_volume" :: held 1.778s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] Created reservations ['b1100245-ca3c-4a5b-955e-a8e1c757cb88', '408c55a8-6770-4cec-bdcd-42f8712ff6f6', 'ad5b5ca3-ad12-44e2-8b9d-9a515cc2db8a', '0cafaf14-5e66-4474-905d-a9a850f32a0e'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:44 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:23:44 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:45 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:45 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.000s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:45 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:23:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dd93bb6d-727e-45e1-87bc-e2280744005c" returned: 0 in 1.046s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dd93bb6d-727e-45e1-87bc-e2280744005c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:45 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] Deleted volume successfully. Jun 15 07:23:45 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dd93bb6d-727e-45e1-87bc-e2280744005c Jun 15 07:23:45 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0ad17427-6f8e-4577-9dc3-e52ba12ddf07 tempest-VolumesActionsTest-444549829 None] Lock "cinder-03f007d4-f7ba-4caa-8756-4080bfe68054-delete_volume" released by "delete_volume" :: held 3.309s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:45 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.693s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:45 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:23:45 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] Deleted volume successfully. Jun 15 07:23:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-52341743-1e0b-461b-9ea6-21058a71d89b tempest-VolumesCloneTest-939341732 None] Lock "cinder-6ca0d51b-3635-43c0-bd64-1ad4968353e1-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:46 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-dd93bb6d-727e-45e1-87bc-e2280744005c" returned: 0 in 0.875s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Lock "cinder-quobyte-dd93bb6d-727e-45e1-87bc-e2280744005c" released by "delete_volume" :: held 2.005s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:46 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Created reservations ['0f61a3e9-55b1-479f-baca-9dada2e07cfc', '62b2ded2-6d94-4e4a-b0de-6c9d88382e45', '476e0f8a-4ba1-4938-99e7-3d6922f84666', '3fe1e40d-8e40-4847-aad7-98cc97c72fc1'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:23:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:46 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:46 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:46 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:23:46 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:47 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.723s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:47 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:23:47 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Deleted volume successfully. Jun 15 07:23:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4d19d677-a6bf-4a86-97f3-841cda87c2e2 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Lock "cinder-dd93bb6d-727e-45e1-87bc-e2280744005c-delete_volume" released by "delete_volume" :: held 3.077s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Flow 'volume_create_manager' (91d9d85b-c90e-4b83-8243-bfe996e23787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d779f98-9cda-4a6a-bd8e-789f3bb428df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d779f98-9cda-4a6a-bd8e-789f3bb428df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-887754059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a932ad6-74bb-4d90-a128-315b49e615d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc55d06840ed412fa416dab1ebff9b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:48Z,use_quota=True,user_id='0582411c067d440d8418f5a3b2d9a3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de62982e-0c94-4867-839b-05e520ca4a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de62982e-0c94-4867-839b-05e520ca4a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6aa8f87-6be0-47a3-929f-479675a2b049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6aa8f87-6be0-47a3-929f-479675a2b049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a932ad6-74bb-4d90-a128-315b49e615d7', 'volume_name': 'volume-1a932ad6-74bb-4d90-a128-315b49e615d7', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca14609c-ebd0-434f-a6a7-69ef42a2ac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca14609c-ebd0-434f-a6a7-69ef42a2ac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf90f894-e596-4be0-96c5-c12d6ecf8eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:48 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Volume 1a932ad6-74bb-4d90-a128-315b49e615d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a932ad6-74bb-4d90-a128-315b49e615d7', 'volume_size': 1} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-887754059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a932ad6-74bb-4d90-a128-315b49e615d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc55d06840ed412fa416dab1ebff9b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:48Z,use_quota=True,user_id='0582411c067d440d8418f5a3b2d9a3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Creating volume 1a932ad6-74bb-4d90-a128-315b49e615d7 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:23:48 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:23:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a932ad6-74bb-4d90-a128-315b49e615d7 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:48 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a932ad6-74bb-4d90-a128-315b49e615d7 1073741824 Jun 15 07:23:48 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:49 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a932ad6-74bb-4d90-a128-315b49e615d7 1073741824" returned: 0 in 1.172s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a932ad6-74bb-4d90-a128-315b49e615d7 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:49 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a932ad6-74bb-4d90-a128-315b49e615d7 Jun 15 07:23:49 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:50 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a932ad6-74bb-4d90-a128-315b49e615d7" returned: 0 in 0.913s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:50 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] <== create_volume: return (2162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:23:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.165s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:50 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf90f894-e596-4be0-96c5-c12d6ecf8eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a932ad6-74bb-4d90-a128-315b49e615d7', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:50 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c751f28-74a0-4fd3-9927-f31a6bfe2612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:50 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Volume volume-1a932ad6-74bb-4d90-a128-315b49e615d7 (1a932ad6-74bb-4d90-a128-315b49e615d7): created successfully Jun 15 07:23:50 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c751f28-74a0-4fd3-9927-f31a6bfe2612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:50 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Flow 'volume_create_manager' (91d9d85b-c90e-4b83-8243-bfe996e23787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:50 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-17086ce2-96d3-4c71-bf23-c9f4291505c8 tempest-VolumeQuotasAdminTestJSON-1193314334 None] Created volume successfully. Jun 15 07:23:52 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-6155484e-7641-48ba-aa42-4bba0fa3fb53 tempest-VolumeQuotasAdminTestJSON-1501274350 None] Transfer volume completed successfully. Jun 15 07:23:53 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] Acquiring lock "cinder-1a932ad6-74bb-4d90-a128-315b49e615d7-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:53 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] Lock "cinder-1a932ad6-74bb-4d90-a128-315b49e615d7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:53 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] Acquiring lock "cinder-quobyte-1a932ad6-74bb-4d90-a128-315b49e615d7" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:53 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] Lock "cinder-quobyte-1a932ad6-74bb-4d90-a128-315b49e615d7" acquired by "delete_volume" :: waited 0.036s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:53 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[417aca79-399c-4872-9e19-bfe500698276]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a932ad6-74bb-4d90-a128-315b49e615d7 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:53 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a932ad6-74bb-4d90-a128-315b49e615d7 Jun 15 07:23:53 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Flow 'volume_create_manager' (74c8919d-c369-45f1-930c-aaf3f1d2bc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f272178-e0b2-4d2e-ae72-4d01a577ab2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f272178-e0b2-4d2e-ae72-4d01a577ab2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2134638727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de024c9-3939-44dd-9c8a-d387520d449c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3a40abdd3547c4af1c4fb4f2e5650e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:54Z,use_quota=True,user_id='37da8e2c8ce442b793258dbdd4cde51b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3463b825-e154-4e4d-afa6-d3f6b0f4d33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3463b825-e154-4e4d-afa6-d3f6b0f4d33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db866fd-d5c5-424f-bc75-4eb23201fd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db866fd-d5c5-424f-bc75-4eb23201fd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5de024c9-3939-44dd-9c8a-d387520d449c', 'volume_name': 'volume-5de024c9-3939-44dd-9c8a-d387520d449c', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa254d1-a134-47cb-95b2-10eb277bc555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa254d1-a134-47cb-95b2-10eb277bc555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909bbaa1-f856-4c50-9c8f-551b24089e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:54 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Volume 5de024c9-3939-44dd-9c8a-d387520d449c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5de024c9-3939-44dd-9c8a-d387520d449c', 'volume_size': 1} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2134638727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de024c9-3939-44dd-9c8a-d387520d449c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3a40abdd3547c4af1c4fb4f2e5650e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:54Z,use_quota=True,user_id='37da8e2c8ce442b793258dbdd4cde51b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Creating volume 5de024c9-3939-44dd-9c8a-d387520d449c {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:23:54 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5de024c9-3939-44dd-9c8a-d387520d449c 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:54 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5de024c9-3939-44dd-9c8a-d387520d449c 1073741824 Jun 15 07:23:54 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:54 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a932ad6-74bb-4d90-a128-315b49e615d7" returned: 0 in 1.077s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a932ad6-74bb-4d90-a128-315b49e615d7 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:54 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a932ad6-74bb-4d90-a128-315b49e615d7 Jun 15 07:23:54 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:55 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5de024c9-3939-44dd-9c8a-d387520d449c 1073741824" returned: 0 in 1.120s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5de024c9-3939-44dd-9c8a-d387520d449c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:55 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5de024c9-3939-44dd-9c8a-d387520d449c Jun 15 07:23:55 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:55 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a932ad6-74bb-4d90-a128-315b49e615d7" returned: 0 in 0.761s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:55 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] Lock "cinder-quobyte-1a932ad6-74bb-4d90-a128-315b49e615d7" released by "delete_volume" :: held 1.892s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:55 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] Created reservations ['20ee22e0-0028-43bd-a151-afed02367484', '48183555-4458-4da6-9178-266cf9a22838', '72867a6b-b37f-4fdf-ad5a-a626564cb1b4', '06bcb4c0-b2f8-49d8-8183-c03c4e72ddb8'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:23:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:55 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:23:55 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:56 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5de024c9-3939-44dd-9c8a-d387520d449c" returned: 0 in 0.796s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:56 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:23:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909bbaa1-f856-4c50-9c8f-551b24089e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5de024c9-3939-44dd-9c8a-d387520d449c', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd680b9-12fb-4851-8ccd-3f84d69c8f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:56 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Volume volume-5de024c9-3939-44dd-9c8a-d387520d449c (5de024c9-3939-44dd-9c8a-d387520d449c): created successfully Jun 15 07:23:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd680b9-12fb-4851-8ccd-3f84d69c8f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Flow 'volume_create_manager' (74c8919d-c369-45f1-930c-aaf3f1d2bc18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:56 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-9871b971-f264-44a5-a7b1-b91a45916d5e tempest-VolumesNegativeTest-440466837 None] Created volume successfully. Jun 15 07:23:56 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.794s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:56 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:23:56 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] Deleted volume successfully. Jun 15 07:23:56 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-87c6a23a-98f2-4320-ae83-d5ad88a01f41 tempest-VolumeQuotasAdminTestJSON-1694937701 None] Lock "cinder-1a932ad6-74bb-4d90-a128-315b49e615d7-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Flow 'volume_create_manager' (060bab48-be38-490e-a1f9-6a4710134a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9832433a-4486-4b96-a129-59c2a217076b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9832433a-4486-4b96-a129-59c2a217076b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-786543655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfac87c-4ad3-4611-87ba-d675a07deac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffd38d53b9b4202bb066044e078211e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:02Z,use_quota=True,user_id='a5be51a0e8464a949f2e7aad45fa69d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103e8000-83b1-4659-b131-06e9328cb317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103e8000-83b1-4659-b131-06e9328cb317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635c9cf8-b0b1-41c5-93ee-a8ee6932ad44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635c9cf8-b0b1-41c5-93ee-a8ee6932ad44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cfac87c-4ad3-4611-87ba-d675a07deac8', 'volume_name': 'volume-2cfac87c-4ad3-4611-87ba-d675a07deac8', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0882703b-d242-461c-9288-456f2cc0081f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0882703b-d242-461c-9288-456f2cc0081f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85cc5674-1647-4040-bd4d-57157e4561ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:02 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Volume 2cfac87c-4ad3-4611-87ba-d675a07deac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cfac87c-4ad3-4611-87ba-d675a07deac8', 'volume_size': 1} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-786543655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfac87c-4ad3-4611-87ba-d675a07deac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffd38d53b9b4202bb066044e078211e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:02Z,use_quota=True,user_id='a5be51a0e8464a949f2e7aad45fa69d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Creating volume 2cfac87c-4ad3-4611-87ba-d675a07deac8 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:24:02 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:24:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2cfac87c-4ad3-4611-87ba-d675a07deac8 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:02 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2cfac87c-4ad3-4611-87ba-d675a07deac8 1073741824 Jun 15 07:24:02 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:03 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2cfac87c-4ad3-4611-87ba-d675a07deac8 1073741824" returned: 0 in 1.038s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2cfac87c-4ad3-4611-87ba-d675a07deac8 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:03 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2cfac87c-4ad3-4611-87ba-d675a07deac8 Jun 15 07:24:03 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:04 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2cfac87c-4ad3-4611-87ba-d675a07deac8" returned: 0 in 0.757s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:24:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85cc5674-1647-4040-bd4d-57157e4561ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cfac87c-4ad3-4611-87ba-d675a07deac8', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef346184-f3d7-45a3-ae79-d16d4b29aeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:04 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Volume volume-2cfac87c-4ad3-4611-87ba-d675a07deac8 (2cfac87c-4ad3-4611-87ba-d675a07deac8): created successfully Jun 15 07:24:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef346184-f3d7-45a3-ae79-d16d4b29aeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Flow 'volume_create_manager' (060bab48-be38-490e-a1f9-6a4710134a25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:04 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-a2b866bf-aec6-4a43-b5e1-b79a59e59645 tempest-VolumesListAdminTestJSON-1983290887 None] Created volume successfully. Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Flow 'volume_create_manager' (7d25dadc-82b8-42d4-8de2-1661e7aa5fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33262a3c-1316-464b-aef0-c630c7c5a1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33262a3c-1316-464b-aef0-c630c7c5a1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1943959842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af79a8b-3150-444f-aaab-a044a2a9b09e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffd38d53b9b4202bb066044e078211e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:06Z,use_quota=True,user_id='a5be51a0e8464a949f2e7aad45fa69d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6032f91b-6599-4e6f-8df1-c0fedce606b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6032f91b-6599-4e6f-8df1-c0fedce606b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d506ae01-f096-43ab-b042-427b4f4fc4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d506ae01-f096-43ab-b042-427b4f4fc4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9af79a8b-3150-444f-aaab-a044a2a9b09e', 'volume_name': 'volume-9af79a8b-3150-444f-aaab-a044a2a9b09e', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d539e0d-b4ce-4238-bb49-d8ac66210059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d539e0d-b4ce-4238-bb49-d8ac66210059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2834bcdd-ba9c-4e45-8ba1-d02fdf41d56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:06 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Volume 9af79a8b-3150-444f-aaab-a044a2a9b09e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9af79a8b-3150-444f-aaab-a044a2a9b09e', 'volume_size': 1} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1943959842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af79a8b-3150-444f-aaab-a044a2a9b09e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffd38d53b9b4202bb066044e078211e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:06Z,use_quota=True,user_id='a5be51a0e8464a949f2e7aad45fa69d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Creating volume 9af79a8b-3150-444f-aaab-a044a2a9b09e {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:24:06 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:24:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9af79a8b-3150-444f-aaab-a044a2a9b09e 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:06 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9af79a8b-3150-444f-aaab-a044a2a9b09e 1073741824 Jun 15 07:24:06 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:07 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:24:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Flow 'volume_create_manager' (969c0aa1-4211-40cf-96ae-28dd32ea0e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0a2580-8760-4df9-b636-8d5611cfa2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0a2580-8760-4df9-b636-8d5611cfa2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1542689334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a2d6a51-42e0-4bc6-92fd-32118d93561a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f33bd0944647a4826d091039f70edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:07Z,use_quota=True,user_id='322f756e62c241d995c150827d14947d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a2056d-7aeb-4703-a1b4-476d30870abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a2056d-7aeb-4703-a1b4-476d30870abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e66ddd-cf22-4e1f-9d36-d4cb314474a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e66ddd-cf22-4e1f-9d36-d4cb314474a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a2d6a51-42e0-4bc6-92fd-32118d93561a', 'volume_name': 'volume-0a2d6a51-42e0-4bc6-92fd-32118d93561a', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:07 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe46b47-7f37-42ec-83bf-5e5ed77256e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe46b47-7f37-42ec-83bf-5e5ed77256e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f8daa1-8b9d-405a-895b-62adff171d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:07 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Volume 0a2d6a51-42e0-4bc6-92fd-32118d93561a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a2d6a51-42e0-4bc6-92fd-32118d93561a', 'volume_size': 1} Jun 15 07:24:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9af79a8b-3150-444f-aaab-a044a2a9b09e 1073741824" returned: 0 in 1.369s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9af79a8b-3150-444f-aaab-a044a2a9b09e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:07 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9af79a8b-3150-444f-aaab-a044a2a9b09e Jun 15 07:24:07 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:08 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9af79a8b-3150-444f-aaab-a044a2a9b09e" returned: 0 in 0.622s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:24:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1542689334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a2d6a51-42e0-4bc6-92fd-32118d93561a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f33bd0944647a4826d091039f70edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:07Z,use_quota=True,user_id='322f756e62c241d995c150827d14947d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:24:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Creating volume 0a2d6a51-42e0-4bc6-92fd-32118d93561a {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:24:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:24:08 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:24:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0a2d6a51-42e0-4bc6-92fd-32118d93561a 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2834bcdd-ba9c-4e45-8ba1-d02fdf41d56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9af79a8b-3150-444f-aaab-a044a2a9b09e', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:08 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0a2d6a51-42e0-4bc6-92fd-32118d93561a 1073741824 Jun 15 07:24:08 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e2ea11-6ef4-4a66-9e60-866faa522da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:08 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Volume volume-9af79a8b-3150-444f-aaab-a044a2a9b09e (9af79a8b-3150-444f-aaab-a044a2a9b09e): created successfully Jun 15 07:24:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e2ea11-6ef4-4a66-9e60-866faa522da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Flow 'volume_create_manager' (7d25dadc-82b8-42d4-8de2-1661e7aa5fff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:08 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-bab5f2aa-8296-4dcf-b086-7ef90e6c3e0f tempest-VolumesListAdminTestJSON-1983290887 None] Created volume successfully. Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Flow 'volume_create_manager' (8f0e4169-9566-450e-b3bf-8be14574c3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7ce159-6ede-4e05-8e87-3552468123d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7ce159-6ede-4e05-8e87-3552468123d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-118920961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffd38d53b9b4202bb066044e078211e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:09Z,use_quota=True,user_id='a5be51a0e8464a949f2e7aad45fa69d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27c9da5-7900-4a19-8c1a-94cc44178c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27c9da5-7900-4a19-8c1a-94cc44178c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7229f17f-7ce6-4677-aafb-3c68572b7997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7229f17f-7ce6-4677-aafb-3c68572b7997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd54c9e2d-3ad3-4822-9fdd-0b0a2fc59927', 'volume_name': 'volume-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1059faae-b8b8-463f-b36b-3d99d636596a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1059faae-b8b8-463f-b36b-3d99d636596a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a890f2-5e00-4a99-b473-f8a2f1307f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:09 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Volume d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927', 'volume_size': 1} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:09 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0a2d6a51-42e0-4bc6-92fd-32118d93561a 1073741824" returned: 0 in 1.083s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0a2d6a51-42e0-4bc6-92fd-32118d93561a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:09 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0a2d6a51-42e0-4bc6-92fd-32118d93561a Jun 15 07:24:09 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:09 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0a2d6a51-42e0-4bc6-92fd-32118d93561a" returned: 0 in 0.631s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.774s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-118920961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffd38d53b9b4202bb066044e078211e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:09Z,use_quota=True,user_id='a5be51a0e8464a949f2e7aad45fa69d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Creating volume d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:24:09 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f8daa1-8b9d-405a-895b-62adff171d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a2d6a51-42e0-4bc6-92fd-32118d93561a', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:09 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927 1073741824 Jun 15 07:24:10 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4f92a2-8c7c-4d19-9485-e3607ef141cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:10 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:10 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Volume volume-0a2d6a51-42e0-4bc6-92fd-32118d93561a (0a2d6a51-42e0-4bc6-92fd-32118d93561a): created successfully Jun 15 07:24:10 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4f92a2-8c7c-4d19-9485-e3607ef141cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:10 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Flow 'volume_create_manager' (969c0aa1-4211-40cf-96ae-28dd32ea0e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:10 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-5c2532f4-d4e0-47f7-b973-b56a4cea57a3 tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Created volume successfully. Jun 15 07:24:10 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927 1073741824" returned: 0 in 0.837s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:10 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927 Jun 15 07:24:10 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:11 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927" returned: 0 in 0.806s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:24:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a890f2-5e00-4a99-b473-f8a2f1307f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97279ccf-7aa5-4238-8130-af5bb62ad2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:11 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Volume volume-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927 (d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927): created successfully Jun 15 07:24:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97279ccf-7aa5-4238-8130-af5bb62ad2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Flow 'volume_create_manager' (8f0e4169-9566-450e-b3bf-8be14574c3e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:11 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-5d1a9791-9a80-4c48-9bcf-699c563e51f6 tempest-VolumesListAdminTestJSON-1983290887 None] Created volume successfully. Jun 15 07:24:11 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Acquiring lock "cinder-0a2d6a51-42e0-4bc6-92fd-32118d93561a-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:11 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Lock "cinder-0a2d6a51-42e0-4bc6-92fd-32118d93561a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:11 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Acquiring lock "cinder-quobyte-0a2d6a51-42e0-4bc6-92fd-32118d93561a" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:11 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Lock "cinder-quobyte-0a2d6a51-42e0-4bc6-92fd-32118d93561a" acquired by "delete_volume" :: waited 0.015s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:11 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[723a22b2-3f57-47ee-9d1c-b6bbea3c43c7]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0a2d6a51-42e0-4bc6-92fd-32118d93561a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:12 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0a2d6a51-42e0-4bc6-92fd-32118d93561a Jun 15 07:24:12 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:12 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0a2d6a51-42e0-4bc6-92fd-32118d93561a" returned: 0 in 0.919s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0a2d6a51-42e0-4bc6-92fd-32118d93561a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:12 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0a2d6a51-42e0-4bc6-92fd-32118d93561a Jun 15 07:24:12 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Flow 'volume_create_manager' (cc769f93-25b2-4923-a97e-960243b91b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64831a3-f15c-475a-8e9f-5ccf59854d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64831a3-f15c-475a-8e9f-5ccf59854d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48a9467-f397-4197-8f36-880fcf7424cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f260ed5945c450d8650d88333512dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:13Z,use_quota=True,user_id='028ebf5cf91142d9b0ca16f237523919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895694bd-0ea5-4b81-9db7-4073f01a85c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895694bd-0ea5-4b81-9db7-4073f01a85c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e82519-90e3-468a-82de-5bd80f678122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e82519-90e3-468a-82de-5bd80f678122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b48a9467-f397-4197-8f36-880fcf7424cd', 'volume_name': 'volume-b48a9467-f397-4197-8f36-880fcf7424cd', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3939f35a-e330-4ba3-ab88-c19e88c169af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3939f35a-e330-4ba3-ab88-c19e88c169af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aae7425-7a63-4656-81ed-ef1767777b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:13 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Volume b48a9467-f397-4197-8f36-880fcf7424cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b48a9467-f397-4197-8f36-880fcf7424cd', 'volume_size': 1} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48a9467-f397-4197-8f36-880fcf7424cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f260ed5945c450d8650d88333512dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:13Z,use_quota=True,user_id='028ebf5cf91142d9b0ca16f237523919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Creating volume b48a9467-f397-4197-8f36-880fcf7424cd {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:24:13 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b48a9467-f397-4197-8f36-880fcf7424cd 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:13 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b48a9467-f397-4197-8f36-880fcf7424cd 1073741824 Jun 15 07:24:13 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:13 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0a2d6a51-42e0-4bc6-92fd-32118d93561a" returned: 0 in 1.114s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Lock "cinder-quobyte-0a2d6a51-42e0-4bc6-92fd-32118d93561a" released by "delete_volume" :: held 2.076s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:13 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:24:13 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:14 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Created reservations ['6503d47e-396c-489d-b98e-4709015ec635', '3053998c-fd0f-44cd-b7fa-f542a59b7257', 'eb0b4a62-a240-411b-b335-ceb91a1623ff', '9e4d6819-f3ea-40d2-a6cb-37cb9a86cdae'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:24:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:14 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:14 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:14 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:24:14 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:14 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b48a9467-f397-4197-8f36-880fcf7424cd 1073741824" returned: 0 in 1.064s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b48a9467-f397-4197-8f36-880fcf7424cd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:14 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b48a9467-f397-4197-8f36-880fcf7424cd Jun 15 07:24:14 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:14 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.870s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:14 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:24:14 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:24:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 8 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:24:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:24:15 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.929s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:15 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:24:15 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Deleted volume successfully. Jun 15 07:24:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0bcd6daf-edb8-462c-b78a-2602f8c2434e tempest-VolumeQuotasNegativeTestJSON-1385796115 None] Lock "cinder-0a2d6a51-42e0-4bc6-92fd-32118d93561a-delete_volume" released by "delete_volume" :: held 3.340s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:15 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b48a9467-f397-4197-8f36-880fcf7424cd" returned: 0 in 0.726s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:15 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:24:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aae7425-7a63-4656-81ed-ef1767777b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b48a9467-f397-4197-8f36-880fcf7424cd', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b372303-34da-4ff8-9716-4be8505cdfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:15 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Volume volume-b48a9467-f397-4197-8f36-880fcf7424cd (b48a9467-f397-4197-8f36-880fcf7424cd): created successfully Jun 15 07:24:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b372303-34da-4ff8-9716-4be8505cdfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Flow 'volume_create_manager' (cc769f93-25b2-4923-a97e-960243b91b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:15 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-5812be1b-c386-42be-be55-65a96bfea1ef tempest-VolumesListAdminTestJSON-791026489 None] Created volume successfully. Jun 15 07:24:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] Acquiring lock "cinder-b48a9467-f397-4197-8f36-880fcf7424cd-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] Lock "cinder-b48a9467-f397-4197-8f36-880fcf7424cd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] Acquiring lock "cinder-quobyte-b48a9467-f397-4197-8f36-880fcf7424cd" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] Lock "cinder-quobyte-b48a9467-f397-4197-8f36-880fcf7424cd" acquired by "delete_volume" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:15 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbb2cfc-cb6d-4660-805c-29a28f667e61]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b48a9467-f397-4197-8f36-880fcf7424cd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] Acquiring lock "cinder-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] Lock "cinder-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] Acquiring lock "cinder-quobyte-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] Lock "cinder-quobyte-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927" acquired by "delete_volume" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:16 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b48a9467-f397-4197-8f36-880fcf7424cd Jun 15 07:24:16 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:16 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95841b3-922e-4d08-a2bf-0512f1d7701d]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:16 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927 Jun 15 07:24:16 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:17 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b48a9467-f397-4197-8f36-880fcf7424cd" returned: 0 in 1.109s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b48a9467-f397-4197-8f36-880fcf7424cd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:17 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b48a9467-f397-4197-8f36-880fcf7424cd Jun 15 07:24:17 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:17 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927" returned: 0 in 1.255s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:17 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927 Jun 15 07:24:17 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:18 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b48a9467-f397-4197-8f36-880fcf7424cd" returned: 0 in 1.021s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:18 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] Lock "cinder-quobyte-b48a9467-f397-4197-8f36-880fcf7424cd" released by "delete_volume" :: held 2.210s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:18 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] Created reservations ['825bd61b-8d4e-4af9-9055-92368d884337', '01acd5dc-9f35-4ea1-9052-bf59b43a105f', '2a71283e-c146-4145-8a38-fcbf4d6efb6a', '41414226-c7fe-44a7-ad3c-a3d8aa83ff66'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:24:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:18 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:24:18 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:18 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927" returned: 0 in 1.280s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:18 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] Lock "cinder-quobyte-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927" released by "delete_volume" :: held 2.617s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:18 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] Created reservations ['845cd464-3693-4a22-8fc2-3e58b262827c', '630d772e-2027-4cea-a1df-08ced70532d9', 'f634420d-4a3b-44b3-829c-4f97cc4d74db', '10d51b3d-f704-42de-b291-d00272ef18ea'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:24:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:19 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:24:19 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:19 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.273s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:19 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:24:19 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] Deleted volume successfully. Jun 15 07:24:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] Acquiring lock "cinder-9af79a8b-3150-444f-aaab-a044a2a9b09e-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-eb63c339-87c9-437c-b1bd-239cc224f80a tempest-VolumesListAdminTestJSON-791026489 None] Lock "cinder-b48a9467-f397-4197-8f36-880fcf7424cd-delete_volume" released by "delete_volume" :: held 4.025s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] Lock "cinder-9af79a8b-3150-444f-aaab-a044a2a9b09e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] Acquiring lock "cinder-quobyte-9af79a8b-3150-444f-aaab-a044a2a9b09e" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] Lock "cinder-quobyte-9af79a8b-3150-444f-aaab-a044a2a9b09e" acquired by "delete_volume" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:20 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[81206e69-9897-40a9-8cfa-14b41f501285]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9af79a8b-3150-444f-aaab-a044a2a9b09e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:20 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.246s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:20 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:24:20 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9af79a8b-3150-444f-aaab-a044a2a9b09e Jun 15 07:24:20 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:20 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] Deleted volume successfully. Jun 15 07:24:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f17e5895-e3ed-4215-811b-b190bf4d481b tempest-VolumesListAdminTestJSON-1983290887 None] Lock "cinder-d54c9e2d-3ad3-4822-9fdd-0b0a2fc59927-delete_volume" released by "delete_volume" :: held 4.298s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:21 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9af79a8b-3150-444f-aaab-a044a2a9b09e" returned: 0 in 1.112s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9af79a8b-3150-444f-aaab-a044a2a9b09e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:21 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9af79a8b-3150-444f-aaab-a044a2a9b09e Jun 15 07:24:21 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:21 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9af79a8b-3150-444f-aaab-a044a2a9b09e" returned: 0 in 0.596s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] Lock "cinder-quobyte-9af79a8b-3150-444f-aaab-a044a2a9b09e" released by "delete_volume" :: held 1.782s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:21 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=78,cinder:INSERT=23,cinder:UPDATE=113,cinder:DELETE=8 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:24:21 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=65,cinder:UPDATE=100,cinder:INSERT=26,cinder:DELETE=12 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:24:21 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] Created reservations ['f8b7668f-9baf-4364-91e6-39d9f778cd7a', '4bec53d3-b33a-44e9-a4ad-f50856d1f7fd', '4196d759-1d05-4ba5-ad07-16151151f2cb', '808e9525-4be5-4072-8957-b03fff9439b2'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:24:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:21 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:24:21 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] Acquiring lock "cinder-2cfac87c-4ad3-4611-87ba-d675a07deac8-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] Lock "cinder-2cfac87c-4ad3-4611-87ba-d675a07deac8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] Acquiring lock "cinder-quobyte-2cfac87c-4ad3-4611-87ba-d675a07deac8" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] Lock "cinder-quobyte-2cfac87c-4ad3-4611-87ba-d675a07deac8" acquired by "delete_volume" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:22 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd353243-12f5-4360-a8f1-4e8b763ff90e]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2cfac87c-4ad3-4611-87ba-d675a07deac8 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:22 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2cfac87c-4ad3-4611-87ba-d675a07deac8 Jun 15 07:24:22 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:22 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.890s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:22 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:24:22 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] Deleted volume successfully. Jun 15 07:24:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-05e90ccc-edb2-4039-95b4-c692f26640ae tempest-VolumesListAdminTestJSON-1983290887 None] Lock "cinder-9af79a8b-3150-444f-aaab-a044a2a9b09e-delete_volume" released by "delete_volume" :: held 2.998s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:22 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Flow 'volume_create_manager' (fa260ccd-eb6a-468f-81ba-53a69603b4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a82b6c9-b3bc-4434-81b7-06ba97df5c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a82b6c9-b3bc-4434-81b7-06ba97df5c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1076642643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e31623b-7db2-4a5a-85d6-65ba7b66ac8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf9e1ad451034849a3a040b9f7d8063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:23Z,use_quota=True,user_id='5e3b2bce93c648f1a501081504459edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334e8a10-9a7b-409b-8265-584b2b469741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334e8a10-9a7b-409b-8265-584b2b469741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944a59be-997e-43ea-8ed7-1fd6f15d684b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944a59be-997e-43ea-8ed7-1fd6f15d684b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e31623b-7db2-4a5a-85d6-65ba7b66ac8c', 'volume_name': 'volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b77c92-66fb-4a97-85ec-282b9c144441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b77c92-66fb-4a97-85ec-282b9c144441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122839e1-5bb9-4d7b-b01c-9631c3e83416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:23 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Volume 5e31623b-7db2-4a5a-85d6-65ba7b66ac8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c', 'volume_size': 1} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1076642643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e31623b-7db2-4a5a-85d6-65ba7b66ac8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf9e1ad451034849a3a040b9f7d8063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:23Z,use_quota=True,user_id='5e3b2bce93c648f1a501081504459edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Creating volume 5e31623b-7db2-4a5a-85d6-65ba7b66ac8c {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:24:23 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:23 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c 1073741824 Jun 15 07:24:23 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:23 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2cfac87c-4ad3-4611-87ba-d675a07deac8" returned: 0 in 0.925s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2cfac87c-4ad3-4611-87ba-d675a07deac8 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:23 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2cfac87c-4ad3-4611-87ba-d675a07deac8 Jun 15 07:24:23 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:23 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2cfac87c-4ad3-4611-87ba-d675a07deac8" returned: 0 in 0.689s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] Lock "cinder-quobyte-2cfac87c-4ad3-4611-87ba-d675a07deac8" released by "delete_volume" :: held 1.684s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:24 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] Created reservations ['25e2a8ab-5d9d-4094-a53e-615242e15795', '4795528c-e9fb-4ac3-a71d-adc9f8825a27', 'd5f1916d-7c48-4c2b-9d54-f1424a73250e', '13368e87-dc60-45bd-9303-1e2a51005cd2'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c 1073741824" returned: 0 in 0.938s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:24 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c Jun 15 07:24:24 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:24 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:24:24 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Flow 'volume_create_manager' (03f6c91b-b4d7-411f-9d63-43bcb373ac99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c4d2b6-6b08-48ce-abf0-c93f4d8422b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c4d2b6-6b08-48ce-abf0-c93f4d8422b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-482274813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1650b28d-90a9-4700-bcd0-c3e248ff5d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0aca2b5fdb3464ea31788487348db93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:25Z,use_quota=True,user_id='f31f3a892dd8488aa0195473f7d3a6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a302f7f-f3b5-49c1-8e16-8dd46c12c448),volume_type_id=9a302f7f-f3b5-49c1-8e16-8dd46c12c448)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5902c3b-2730-41ab-ad84-8efbdf1cd957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5902c3b-2730-41ab-ad84-8efbdf1cd957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6355a120-059f-4890-8df5-f52caf29d873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6355a120-059f-4890-8df5-f52caf29d873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1650b28d-90a9-4700-bcd0-c3e248ff5d94', 'volume_name': 'volume-1650b28d-90a9-4700-bcd0-c3e248ff5d94', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca04c07-0b58-4823-969e-2a20caf512e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca04c07-0b58-4823-969e-2a20caf512e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0487474f-bd7f-43d9-9f37-dc58b0e6856c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:24 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Volume 1650b28d-90a9-4700-bcd0-c3e248ff5d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1650b28d-90a9-4700-bcd0-c3e248ff5d94', 'volume_size': 1} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:24 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c" returned: 0 in 0.791s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.223s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-482274813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1650b28d-90a9-4700-bcd0-c3e248ff5d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0aca2b5fdb3464ea31788487348db93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:25Z,use_quota=True,user_id='f31f3a892dd8488aa0195473f7d3a6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a302f7f-f3b5-49c1-8e16-8dd46c12c448),volume_type_id=9a302f7f-f3b5-49c1-8e16-8dd46c12c448)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Creating volume 1650b28d-90a9-4700-bcd0-c3e248ff5d94 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:24:24 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1650b28d-90a9-4700-bcd0-c3e248ff5d94 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:24 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:24 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1650b28d-90a9-4700-bcd0-c3e248ff5d94 1073741824 Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122839e1-5bb9-4d7b-b01c-9631c3e83416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:24 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d6e4f0-f0fc-4070-998d-fa64c94792b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.795s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:24 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:24:24 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] Deleted volume successfully. Jun 15 07:24:25 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Volume volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c (5e31623b-7db2-4a5a-85d6-65ba7b66ac8c): created successfully Jun 15 07:24:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d6e4f0-f0fc-4070-998d-fa64c94792b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Flow 'volume_create_manager' (fa260ccd-eb6a-468f-81ba-53a69603b4b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:25 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-319ec003-1b9c-4e0f-9d0e-3c43341c2c87 tempest-VolumesListAdminTestJSON-1983290887 None] Lock "cinder-2cfac87c-4ad3-4611-87ba-d675a07deac8-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:25 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-d8bf7bb9-46c7-4fb9-8082-2a1b1f3d8e1f tempest-AttachVolumeTestJSON-1407893396 None] Created volume successfully. Jun 15 07:24:25 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1650b28d-90a9-4700-bcd0-c3e248ff5d94 1073741824" returned: 0 in 0.939s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1650b28d-90a9-4700-bcd0-c3e248ff5d94 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:25 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1650b28d-90a9-4700-bcd0-c3e248ff5d94 Jun 15 07:24:25 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:26 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1650b28d-90a9-4700-bcd0-c3e248ff5d94" returned: 0 in 0.763s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:24:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0487474f-bd7f-43d9-9f37-dc58b0e6856c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1650b28d-90a9-4700-bcd0-c3e248ff5d94', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237e5ab4-d7f4-4269-b8ff-83ee6b57b26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:26 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Volume volume-1650b28d-90a9-4700-bcd0-c3e248ff5d94 (1650b28d-90a9-4700-bcd0-c3e248ff5d94): created successfully Jun 15 07:24:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237e5ab4-d7f4-4269-b8ff-83ee6b57b26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Flow 'volume_create_manager' (03f6c91b-b4d7-411f-9d63-43bcb373ac99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:26 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-65d7ea17-2882-4092-ab4f-ac357c19c2b3 tempest-VolumeTypesAccessTest-783523228 None] Created volume successfully. Jun 15 07:24:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Acquiring lock "cinder-1650b28d-90a9-4700-bcd0-c3e248ff5d94-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Lock "cinder-1650b28d-90a9-4700-bcd0-c3e248ff5d94-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Acquiring lock "cinder-quobyte-1650b28d-90a9-4700-bcd0-c3e248ff5d94" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Lock "cinder-quobyte-1650b28d-90a9-4700-bcd0-c3e248ff5d94" acquired by "delete_volume" :: waited 0.018s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:28 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc18ae7f-4203-4a4e-b4f2-a5c3ed2190cb]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1650b28d-90a9-4700-bcd0-c3e248ff5d94 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:28 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1650b28d-90a9-4700-bcd0-c3e248ff5d94 Jun 15 07:24:28 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:28 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1650b28d-90a9-4700-bcd0-c3e248ff5d94" returned: 0 in 0.881s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1650b28d-90a9-4700-bcd0-c3e248ff5d94 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:28 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1650b28d-90a9-4700-bcd0-c3e248ff5d94 Jun 15 07:24:28 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-128c6035-9a6e-4531-af9c-c78d2abb1c4a req-7323153a-c225-41e0-9992-fedb85e94cfa tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-128c6035-9a6e-4531-af9c-c78d2abb1c4a req-7323153a-c225-41e0-9992-fedb85e94cfa tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:29 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[748ea51c-6590-4b08-a80d-7c968a80ba35]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-128c6035-9a6e-4531-af9c-c78d2abb1c4a req-7323153a-c225-41e0-9992-fedb85e94cfa tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:29 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c Jun 15 07:24:29 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:29 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1650b28d-90a9-4700-bcd0-c3e248ff5d94" returned: 0 in 0.755s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:29 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Lock "cinder-quobyte-1650b28d-90a9-4700-bcd0-c3e248ff5d94" released by "delete_volume" :: held 1.693s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:29 devstack cinder-volume[92129]: WARNING cinder.quota [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-655475573 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-655475573, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:24:29 devstack cinder-volume[92129]: WARNING cinder.quota [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-655475573 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-655475573, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:24:29 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Created reservations ['50f2c7c6-a9cf-42af-a2b6-bc620381f1b0', '44274106-d29e-4a83-92a5-dcec2a016d9e', 'b525c4e9-4b93-49cc-8981-afb4c1cf19cd', '5e2ffce4-c9d5-41db-89f8-2405c0c7393b'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:24:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:29 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:24:29 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:30 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-128c6035-9a6e-4531-af9c-c78d2abb1c4a req-7323153a-c225-41e0-9992-fedb85e94cfa tempest-AttachVolumeTestJSON-1407893396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c" returned: 0 in 0.854s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-128c6035-9a6e-4531-af9c-c78d2abb1c4a req-7323153a-c225-41e0-9992-fedb85e94cfa tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.874s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-128c6035-9a6e-4531-af9c-c78d2abb1c4a req-7323153a-c225-41e0-9992-fedb85e94cfa tempest-AttachVolumeTestJSON-1407893396 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd91647c-4a89-434f-9f09-a9d5ceda8189', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:24:30 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-128c6035-9a6e-4531-af9c-c78d2abb1c4a req-7323153a-c225-41e0-9992-fedb85e94cfa tempest-AttachVolumeTestJSON-1407893396 None] attachment_update completed successfully. Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Flow 'volume_create_manager' (838aa82d-11e8-4ce1-98d9-31df7e4eeae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f880785-804e-4cee-a6c0-04d36bcc3bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f880785-804e-4cee-a6c0-04d36bcc3bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1870092050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce54295-2cd0-4c1f-b9d6-da86975b8f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d085aad713154f2e894b844469cc8984',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:31Z,use_quota=True,user_id='f2f5abea765c4b11972420245389662b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (427251f0-e240-4549-95c8-8e3a6a16d77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:30 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (427251f0-e240-4549-95c8-8e3a6a16d77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd902734-5000-4ebe-8019-88340fe6fd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd902734-5000-4ebe-8019-88340fe6fd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce54295-2cd0-4c1f-b9d6-da86975b8f2d', 'volume_name': 'volume-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c613671-d2ce-4912-a6e2-60cb6105f921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c613671-d2ce-4912-a6e2-60cb6105f921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa64dcd4-d69e-4ac2-bdbb-cd310adb2124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:30 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Volume 6ce54295-2cd0-4c1f-b9d6-da86975b8f2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d', 'volume_size': 1} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1870092050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce54295-2cd0-4c1f-b9d6-da86975b8f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d085aad713154f2e894b844469cc8984',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:31Z,use_quota=True,user_id='f2f5abea765c4b11972420245389662b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Creating volume 6ce54295-2cd0-4c1f-b9d6-da86975b8f2d {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:24:30 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.822s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:24:30 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Deleted volume successfully. Jun 15 07:24:30 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d 1073741824 Jun 15 07:24:30 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:30 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-51c137ba-f615-481d-ac62-d6a97a9a8bc1 tempest-VolumeTypesAccessTest-783523228 None] Lock "cinder-1650b28d-90a9-4700-bcd0-c3e248ff5d94-delete_volume" released by "delete_volume" :: held 2.829s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:31 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d 1073741824" returned: 0 in 1.018s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:31 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d Jun 15 07:24:31 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:32 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d" returned: 0 in 0.757s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:24:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa64dcd4-d69e-4ac2-bdbb-cd310adb2124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9525d4-abf9-4a23-b873-a83a6fdfbb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:32 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Volume volume-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d (6ce54295-2cd0-4c1f-b9d6-da86975b8f2d): created successfully Jun 15 07:24:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9525d4-abf9-4a23-b873-a83a6fdfbb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Flow 'volume_create_manager' (838aa82d-11e8-4ce1-98d9-31df7e4eeae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:32 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-69e11fff-3825-4f28-a647-f09c8cb9ad39 tempest-AbsoluteLimitsTests-1444895282 None] Created volume successfully. Jun 15 07:24:33 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] Acquiring lock "cinder-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:33 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] Lock "cinder-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:33 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] Acquiring lock "cinder-quobyte-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:33 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] Lock "cinder-quobyte-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d" acquired by "delete_volume" :: waited 0.023s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:33 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad3dcec-cab0-47ef-9b7d-ff37f42f3d89]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:33 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d Jun 15 07:24:33 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] Acquiring lock "cinder-5de024c9-3939-44dd-9c8a-d387520d449c-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:34 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] Lock "cinder-5de024c9-3939-44dd-9c8a-d387520d449c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d" returned: 0 in 0.940s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:34 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d Jun 15 07:24:34 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] Acquiring lock "cinder-quobyte-5de024c9-3939-44dd-9c8a-d387520d449c" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] Lock "cinder-quobyte-5de024c9-3939-44dd-9c8a-d387520d449c" acquired by "delete_volume" :: waited 0.030s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:34 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe4944a-fb3f-42a9-8a92-62634dd8e7ed]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5de024c9-3939-44dd-9c8a-d387520d449c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:34 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5de024c9-3939-44dd-9c8a-d387520d449c Jun 15 07:24:34 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:34 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d" returned: 0 in 0.744s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] Lock "cinder-quobyte-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d" released by "delete_volume" :: held 1.744s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:34 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] Created reservations ['066cf22e-bc22-4044-b782-6f0d23b67778', '6b38b589-aebd-40de-8554-9b7725098a0a', 'c2f8c14e-60c9-43f1-8766-f49c2e6f76bb', '62bd1891-5811-4cd1-a636-3ab08858489b'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:24:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:35 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:35 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:35 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5de024c9-3939-44dd-9c8a-d387520d449c" returned: 0 in 0.869s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5de024c9-3939-44dd-9c8a-d387520d449c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:35 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:24:35 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:35 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5de024c9-3939-44dd-9c8a-d387520d449c Jun 15 07:24:35 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:35 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:24:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Flow 'volume_create_manager' (d2608f99-6543-4108-b6eb-a10c91fdd5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828112b3-4c33-4861-87c4-ae27d1e2476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828112b3-4c33-4861-87c4-ae27d1e2476d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-539401470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=345e784f-5c90-4ad8-bbf7-566ef68439d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf9e1ad451034849a3a040b9f7d8063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:36Z,use_quota=True,user_id='5e3b2bce93c648f1a501081504459edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748c3380-e646-4a04-b861-c58721e6a0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748c3380-e646-4a04-b861-c58721e6a0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b96be8d-cba1-4eac-b164-30299e13ceb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b96be8d-cba1-4eac-b164-30299e13ceb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '345e784f-5c90-4ad8-bbf7-566ef68439d9', 'volume_name': 'volume-345e784f-5c90-4ad8-bbf7-566ef68439d9', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26cc4222-f5c8-4379-bb4d-c5f647d60877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26cc4222-f5c8-4379-bb4d-c5f647d60877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a85f0eb-9af0-4612-aabd-899e35001f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:36 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Volume 345e784f-5c90-4ad8-bbf7-566ef68439d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-345e784f-5c90-4ad8-bbf7-566ef68439d9', 'volume_size': 1} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-539401470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=345e784f-5c90-4ad8-bbf7-566ef68439d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf9e1ad451034849a3a040b9f7d8063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:36Z,use_quota=True,user_id='5e3b2bce93c648f1a501081504459edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Creating volume 345e784f-5c90-4ad8-bbf7-566ef68439d9 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:36 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:24:36 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-345e784f-5c90-4ad8-bbf7-566ef68439d9 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5de024c9-3939-44dd-9c8a-d387520d449c" returned: 0 in 0.904s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] Lock "cinder-quobyte-5de024c9-3939-44dd-9c8a-d387520d449c" released by "delete_volume" :: held 1.829s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:36 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-345e784f-5c90-4ad8-bbf7-566ef68439d9 1073741824 Jun 15 07:24:36 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] Created reservations ['85b33713-7dfb-48c7-8185-77301703ecb8', '56dda677-3630-48c9-85a2-2b0a4430e50a', '79e25cf8-ae8e-4b63-83b7-021d94b84b8a', 'e011bf50-985d-4eae-869b-667e64ef6a6b'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:24:36 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.095s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:24:36 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] Deleted volume successfully. Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-05e19f44-f88b-4149-8fab-b1bfe759a78c tempest-AbsoluteLimitsTests-1444895282 None] Lock "cinder-6ce54295-2cd0-4c1f-b9d6-da86975b8f2d-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:36 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:24:36 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:37 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.898s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:37 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:24:37 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] Deleted volume successfully. Jun 15 07:24:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5489bb38-b05e-408e-ba62-07e11a3b2c92 tempest-VolumesNegativeTest-440466837 None] Lock "cinder-5de024c9-3939-44dd-9c8a-d387520d449c-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:37 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-345e784f-5c90-4ad8-bbf7-566ef68439d9 1073741824" returned: 0 in 1.292s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-345e784f-5c90-4ad8-bbf7-566ef68439d9 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:37 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-345e784f-5c90-4ad8-bbf7-566ef68439d9 Jun 15 07:24:37 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:38 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-345e784f-5c90-4ad8-bbf7-566ef68439d9" returned: 0 in 0.725s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:24:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:38 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a85f0eb-9af0-4612-aabd-899e35001f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-345e784f-5c90-4ad8-bbf7-566ef68439d9', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:38 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990e064c-e4fc-4d95-921a-2989e6fef5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:38 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Volume volume-345e784f-5c90-4ad8-bbf7-566ef68439d9 (345e784f-5c90-4ad8-bbf7-566ef68439d9): created successfully Jun 15 07:24:38 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990e064c-e4fc-4d95-921a-2989e6fef5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:38 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Flow 'volume_create_manager' (d2608f99-6543-4108-b6eb-a10c91fdd5cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:38 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-a124d0d3-dc2d-4680-b146-d7dbbe9ed097 tempest-AttachVolumeTestJSON-1407893396 None] Created volume successfully. Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Flow 'volume_create_manager' (88c05d00-559c-4110-8650-cc8624d78503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93e01e8-e6a5-462a-a7ae-a7fc984b3c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93e01e8-e6a5-462a-a7ae-a7fc984b3c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-413259933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a7e693-972b-4f24-9121-e37f923d3453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b8e62608245d0a9733824898f4c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:40Z,use_quota=True,user_id='e26d0124415246b5ac7a6750f10eb85a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6db040-9dc0-4a45-8f56-3b115f13839b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6db040-9dc0-4a45-8f56-3b115f13839b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce420418-c947-495b-9537-5a2b99ecdc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce420418-c947-495b-9537-5a2b99ecdc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a7e693-972b-4f24-9121-e37f923d3453', 'volume_name': 'volume-89a7e693-972b-4f24-9121-e37f923d3453', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9277dadc-40aa-4094-86f3-8d6b34611171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9277dadc-40aa-4094-86f3-8d6b34611171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f772b4-af00-4ef8-a8d6-930369e3777e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:40 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Volume 89a7e693-972b-4f24-9121-e37f923d3453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a7e693-972b-4f24-9121-e37f923d3453', 'volume_size': 1} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-413259933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a7e693-972b-4f24-9121-e37f923d3453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b8e62608245d0a9733824898f4c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:40Z,use_quota=True,user_id='e26d0124415246b5ac7a6750f10eb85a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Creating volume 89a7e693-972b-4f24-9121-e37f923d3453 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:24:40 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:24:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:40 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453 1073741824 Jun 15 07:24:40 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:41 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:24:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Flow 'volume_create_manager' (dc2d1b54-3773-4490-8e48-3db22a8593dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ab8866-6f5c-4c08-9449-cc3bfee06cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ab8866-6f5c-4c08-9449-cc3bfee06cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1774509427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=593ca080-e6e9-4e8d-bef9-e29a9160e029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f63a9f2d16149d092ef375ff96a07ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:41Z,use_quota=True,user_id='211ff20613f34d7fbf4e3e9cc3d358ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0babd910-4164-47da-a90f-56a1b6ac5f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0babd910-4164-47da-a90f-56a1b6ac5f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c23909-7b42-4d7e-b5c9-5cc10a603e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c23909-7b42-4d7e-b5c9-5cc10a603e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '593ca080-e6e9-4e8d-bef9-e29a9160e029', 'volume_name': 'volume-593ca080-e6e9-4e8d-bef9-e29a9160e029', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e965a6e1-815e-430a-aa83-20f5f8fd5449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e965a6e1-815e-430a-aa83-20f5f8fd5449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6ae2eb-eda4-488e-9a93-89d096d078f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:41 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Volume 593ca080-e6e9-4e8d-bef9-e29a9160e029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-593ca080-e6e9-4e8d-bef9-e29a9160e029', 'volume_size': 1} Jun 15 07:24:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:41 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453 1073741824" returned: 0 in 0.936s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:41 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453 Jun 15 07:24:41 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:42 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453" returned: 0 in 0.664s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1774509427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=593ca080-e6e9-4e8d-bef9-e29a9160e029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f63a9f2d16149d092ef375ff96a07ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:41Z,use_quota=True,user_id='211ff20613f34d7fbf4e3e9cc3d358ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Creating volume 593ca080-e6e9-4e8d-bef9-e29a9160e029 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:24:42 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f772b4-af00-4ef8-a8d6-930369e3777e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a7e693-972b-4f24-9121-e37f923d3453', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f82008-2a80-44b9-9e26-1216e1f0d95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:42 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029 1073741824 Jun 15 07:24:42 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:42 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Volume volume-89a7e693-972b-4f24-9121-e37f923d3453 (89a7e693-972b-4f24-9121-e37f923d3453): created successfully Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f82008-2a80-44b9-9e26-1216e1f0d95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Flow 'volume_create_manager' (88c05d00-559c-4110-8650-cc8624d78503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:42 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-14cc209a-a923-4bec-8be3-2caefb596c1c tempest-VolumesSnapshotListTestJSON-1856966152 None] Created volume successfully. Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-85dc608d-3fc2-4d83-aede-9cdb90906e87 req-11ba0d81-5342-4b21-8062-6667091b00a8 tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:43 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029 1073741824" returned: 0 in 0.954s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:43 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029 Jun 15 07:24:43 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:43 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029" returned: 0 in 0.635s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:24:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.972s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] Creating offline snapshot 0972af58-d305-4b38-9080-259af758661d of volume 89a7e693-972b-4f24-9121-e37f923d3453 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:24:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6ae2eb-eda4-488e-9a93-89d096d078f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-593ca080-e6e9-4e8d-bef9-e29a9160e029', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8a6b6a-cbbb-4b97-999a-e7496e92fe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:43 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[45185e11-2730-485b-9ca5-02bd53148d39]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:43 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Volume volume-593ca080-e6e9-4e8d-bef9-e29a9160e029 (593ca080-e6e9-4e8d-bef9-e29a9160e029): created successfully Jun 15 07:24:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8a6b6a-cbbb-4b97-999a-e7496e92fe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Flow 'volume_create_manager' (dc2d1b54-3773-4490-8e48-3db22a8593dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:43 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-2cc7983d-560d-4791-b995-6c5ffd9bc6ff tempest-VolumesDeleteCascade-1983287083 None] Created volume successfully. Jun 15 07:24:44 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453 Jun 15 07:24:44 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:44 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453" returned: 0 in 0.835s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:44 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d 1G Jun 15 07:24:44 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:45 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d 1G" returned: 0 in 0.798s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a7e693-972b-4f24-9121-e37f923d3453 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:45 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a7e693-972b-4f24-9121-e37f923d3453 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d Jun 15 07:24:45 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:46 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a7e693-972b-4f24-9121-e37f923d3453 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d" returned: 0 in 0.730s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:46 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d is being set with open permissions: ugo+rw Jun 15 07:24:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:46 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d Jun 15 07:24:46 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:46 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d" returned: 0 in 0.651s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:47 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.info Jun 15 07:24:47 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:47 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.info" returned: 0 in 0.636s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:47 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.info is being set with open permissions: ugo+rw Jun 15 07:24:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:47 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.info Jun 15 07:24:47 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:48 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.info" returned: 0 in 0.636s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.394s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-85dc608d-3fc2-4d83-aede-9cdb90906e87 req-11ba0d81-5342-4b21-8062-6667091b00a8 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.340s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:48 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b40db8-db76-45f8-b1ea-ee0d06b6c3df]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-85dc608d-3fc2-4d83-aede-9cdb90906e87 req-11ba0d81-5342-4b21-8062-6667091b00a8 tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-345e784f-5c90-4ad8-bbf7-566ef68439d9 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:48 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-678a188a-4f18-483b-875c-ad90073aeffb tempest-VolumesSnapshotListTestJSON-1856966152 None] Create snapshot completed successfully Jun 15 07:24:48 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-345e784f-5c90-4ad8-bbf7-566ef68439d9 Jun 15 07:24:48 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:49 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-85dc608d-3fc2-4d83-aede-9cdb90906e87 req-11ba0d81-5342-4b21-8062-6667091b00a8 tempest-AttachVolumeTestJSON-1407893396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-345e784f-5c90-4ad8-bbf7-566ef68439d9" returned: 0 in 0.734s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-85dc608d-3fc2-4d83-aede-9cdb90906e87 req-11ba0d81-5342-4b21-8062-6667091b00a8 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.762s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.343s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] Creating offline snapshot 7f81024a-157b-46bd-aa44-06bbf3854572 of volume 593ca080-e6e9-4e8d-bef9-e29a9160e029 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:24:49 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3da869-6aa3-4e0a-a647-c5da367f43a3]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:49 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-85dc608d-3fc2-4d83-aede-9cdb90906e87 req-11ba0d81-5342-4b21-8062-6667091b00a8 tempest-AttachVolumeTestJSON-1407893396 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-345e784f-5c90-4ad8-bbf7-566ef68439d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f2f2f75-5417-4dd5-a01c-9bb39211fa9b', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:24:49 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-85dc608d-3fc2-4d83-aede-9cdb90906e87 req-11ba0d81-5342-4b21-8062-6667091b00a8 tempest-AttachVolumeTestJSON-1407893396 None] attachment_update completed successfully. Jun 15 07:24:49 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029 Jun 15 07:24:49 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5b21ae4d-b2e9-4d98-8e57-0635d552a462 tempest-VolumesSnapshotListTestJSON-1856966152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:49 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029" returned: 0 in 0.838s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:49 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 1G Jun 15 07:24:49 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:50 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 1G" returned: 0 in 0.988s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-593ca080-e6e9-4e8d-bef9-e29a9160e029 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:50 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-593ca080-e6e9-4e8d-bef9-e29a9160e029 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 Jun 15 07:24:50 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:51 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-593ca080-e6e9-4e8d-bef9-e29a9160e029 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572" returned: 0 in 0.772s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:51 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 is being set with open permissions: ugo+rw Jun 15 07:24:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:51 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 Jun 15 07:24:51 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:52 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572" returned: 0 in 0.597s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:52 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.info Jun 15 07:24:52 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:52 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.info" returned: 0 in 0.644s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:52 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.info is being set with open permissions: ugo+rw Jun 15 07:24:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:53 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.info Jun 15 07:24:53 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:53 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.info" returned: 0 in 0.689s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.654s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5b21ae4d-b2e9-4d98-8e57-0635d552a462 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.202s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5b21ae4d-b2e9-4d98-8e57-0635d552a462 tempest-VolumesSnapshotListTestJSON-1856966152 None] Creating offline snapshot 980fd937-6ff3-4f3d-849b-957eaccf3e20 of volume 89a7e693-972b-4f24-9121-e37f923d3453 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:24:53 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-15b38454-e89c-4044-aff1-0a8fccc72585 tempest-VolumesDeleteCascade-1983287083 None] Create snapshot completed successfully Jun 15 07:24:53 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[87788389-7b9b-4886-9fec-cbdb5e84f870]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5b21ae4d-b2e9-4d98-8e57-0635d552a462 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:53 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d Jun 15 07:24:53 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-edb4f36c-c0df-4022-9311-204e3e859454 tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:54 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5b21ae4d-b2e9-4d98-8e57-0635d552a462 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d" returned: 0 in 0.893s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5b21ae4d-b2e9-4d98-8e57-0635d552a462 tempest-VolumesSnapshotListTestJSON-1856966152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89a7e693-972b-4f24-9121-e37f923d3453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:24:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5b21ae4d-b2e9-4d98-8e57-0635d552a462 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:54 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 1G Jun 15 07:24:54 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:55 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5b21ae4d-b2e9-4d98-8e57-0635d552a462 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 1G" returned: 0 in 0.866s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5b21ae4d-b2e9-4d98-8e57-0635d552a462 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:55 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 Jun 15 07:24:55 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:56 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:24:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Flow 'volume_create_manager' (9fdb4756-633d-4cdb-af13-8e91204def99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33490540-72ca-4584-9528-48c16e4cf59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33490540-72ca-4584-9528-48c16e4cf59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-940134036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe38999b-2f8a-4e20-b882-3a87d9dea29e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3ad0365e0d4654be0ba499737768a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:56Z,use_quota=True,user_id='fc52bd02bcd44e30a4d19619e18ba94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96e66bf-6032-4350-93c4-6ee78fce3c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96e66bf-6032-4350-93c4-6ee78fce3c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d191f8ce-0b26-441f-a51d-f2f6c0910eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:56 devstack cinder-volume[92129]: DEBUG cinder.image.glance [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Creating Keystone auth plugin from conf {{(pid=92129) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:24:56 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-3b25b653-f7d5-494f-9e18-6cedb4354684 req-fc7f842f-a305-45a5-a373-7e86d5f80b55 tempest-AttachVolumeTestJSON-1407893396 None] Terminate volume connection completed successfully. Jun 15 07:24:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-3b25b653-f7d5-494f-9e18-6cedb4354684 req-fc7f842f-a305-45a5-a373-7e86d5f80b55 tempest-AttachVolumeTestJSON-1407893396 None] Deleting attachment bd91647c-4a89-434f-9f09-a9d5ceda8189. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:24:56 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5b21ae4d-b2e9-4d98-8e57-0635d552a462 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20" returned: 0 in 0.720s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:56 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-5b21ae4d-b2e9-4d98-8e57-0635d552a462 tempest-VolumesSnapshotListTestJSON-1856966152 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 is being set with open permissions: ugo+rw Jun 15 07:24:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5b21ae4d-b2e9-4d98-8e57-0635d552a462 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:56 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 Jun 15 07:24:56 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d191f8ce-0b26-441f-a51d-f2f6c0910eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fe38999b-2f8a-4e20-b882-3a87d9dea29e', 'volume_name': 'volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e', 'volume_size': 1, 'image_id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0d4c76bb4c8424fbbbc7d856674ea3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'created_at': datetime.datetime(2026, 6, 15, 5, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af781faa-2398-41b5-9cb2-cfe0761734f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa60cd0-c0a1-47f4-a5e7-64128a8b74b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa60cd0-c0a1-47f4-a5e7-64128a8b74b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec28d4d9-96f7-4b1b-807b-9a6a6cc87110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:56 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Volume fe38999b-2f8a-4e20-b882-3a87d9dea29e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e', 'volume_size': 1, 'image_id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0d4c76bb4c8424fbbbc7d856674ea3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'created_at': datetime.datetime(2026, 6, 15, 5, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af781faa-2398-41b5-9cb2-cfe0761734f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 15 07:24:56 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Trying to clone fe38999b-2f8a-4e20-b882-3a87d9dea29e from image af781faa-2398-41b5-9cb2-cfe0761734f9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}]). {{(pid=92129) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:24:56 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5b21ae4d-b2e9-4d98-8e57-0635d552a462 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20" returned: 0 in 0.635s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5b21ae4d-b2e9-4d98-8e57-0635d552a462 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.308s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-edb4f36c-c0df-4022-9311-204e3e859454 tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.580s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-edb4f36c-c0df-4022-9311-204e3e859454 tempest-VolumesDeleteCascade-1983287083 None] Creating offline snapshot 196be9f6-2b7c-480d-9dcc-6b4eb5390877 of volume 593ca080-e6e9-4e8d-bef9-e29a9160e029 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:24:57 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_q52c3qhfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:24:57 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Image download 20.69 MB at 20.69 MB/s Jun 15 07:24:57 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3310d9-781d-4f06-b795-61d1815c5398]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-edb4f36c-c0df-4022-9311-204e3e859454 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:57 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-5b21ae4d-b2e9-4d98-8e57-0635d552a462 tempest-VolumesSnapshotListTestJSON-1856966152 None] Create snapshot completed successfully Jun 15 07:24:57 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf363d0-820c-41ef-bceb-5a1629b82a86]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_q52c3qhfdevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:57 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 Jun 15 07:24:57 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:57 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_q52c3qhfdevstack@QuobyteHD Jun 15 07:24:57 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:57 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_q52c3qhfdevstack@QuobyteHD" returned: 0 in 0.707s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:57 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Temporary image af781faa-2398-41b5-9cb2-cfe0761734f9 is fetched for user fc52bd02bcd44e30a4d19619e18ba94d. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:24:57 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-edb4f36c-c0df-4022-9311-204e3e859454 tempest-VolumesDeleteCascade-1983287083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572" returned: 0 in 0.775s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-edb4f36c-c0df-4022-9311-204e3e859454 tempest-VolumesDeleteCascade-1983287083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-593ca080-e6e9-4e8d-bef9-e29a9160e029(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:24:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-edb4f36c-c0df-4022-9311-204e3e859454 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:57 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877 1G Jun 15 07:24:57 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:57 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd3a4cb-85e4-4e0b-a52f-c65434f12fd4]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_q52c3qhfdevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1ea46bc1-ac45-44e6-a30f-3189bfa62d66 tempest-VolumesSnapshotListTestJSON-1856966152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:58 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_q52c3qhfdevstack@QuobyteHD Jun 15 07:24:58 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:58 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-edb4f36c-c0df-4022-9311-204e3e859454 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877 1G" returned: 0 in 0.855s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-edb4f36c-c0df-4022-9311-204e3e859454 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:58 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_q52c3qhfdevstack@QuobyteHD" returned: 0 in 0.780s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:58 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877 Jun 15 07:24:58 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:59 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-edb4f36c-c0df-4022-9311-204e3e859454 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877" returned: 0 in 0.706s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:59 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-edb4f36c-c0df-4022-9311-204e3e859454 tempest-VolumesDeleteCascade-1983287083 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877 is being set with open permissions: ugo+rw Jun 15 07:24:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-edb4f36c-c0df-4022-9311-204e3e859454 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:59 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-2a417ce0-9fb3-497b-8327-5256ace523a8 req-4728946a-8d93-48a1-b117-31bd2e7c0cf2 tempest-AttachVolumeTestJSON-1407893396 None] Terminate volume connection completed successfully. Jun 15 07:24:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-2a417ce0-9fb3-497b-8327-5256ace523a8 req-4728946a-8d93-48a1-b117-31bd2e7c0cf2 tempest-AttachVolumeTestJSON-1407893396 None] Deleting attachment 3f2f2f75-5417-4dd5-a01c-9bb39211fa9b. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:24:59 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877 Jun 15 07:24:59 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:00 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-edb4f36c-c0df-4022-9311-204e3e859454 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877" returned: 0 in 0.611s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-edb4f36c-c0df-4022-9311-204e3e859454 tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.078s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1ea46bc1-ac45-44e6-a30f-3189bfa62d66 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.983s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-1ea46bc1-ac45-44e6-a30f-3189bfa62d66 tempest-VolumesSnapshotListTestJSON-1856966152 None] Creating offline snapshot a2a0a0af-28bd-4700-b387-1ef305d0e781 of volume 89a7e693-972b-4f24-9121-e37f923d3453 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1bf3d0-52e2-468b-9766-e3352d14a90c]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1ea46bc1-ac45-44e6-a30f-3189bfa62d66 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:00 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-edb4f36c-c0df-4022-9311-204e3e859454 tempest-VolumesDeleteCascade-1983287083 None] Create snapshot completed successfully Jun 15 07:25:00 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 Jun 15 07:25:00 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "cinder-593ca080-e6e9-4e8d-bef9-e29a9160e029-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-593ca080-e6e9-4e8d-bef9-e29a9160e029-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Performing cascade delete. {{(pid=92129) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "cinder-196be9f6-2b7c-480d-9dcc-6b4eb5390877-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-196be9f6-2b7c-480d-9dcc-6b4eb5390877-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "cinder-quobyte-593ca080-e6e9-4e8d-bef9-e29a9160e029" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-593ca080-e6e9-4e8d-bef9-e29a9160e029" acquired by "delete_snapshot" :: waited 0.014s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "cinder-quobyte-196be9f6-2b7c-480d-9dcc-6b4eb5390877" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-196be9f6-2b7c-480d-9dcc-6b4eb5390877" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Deleting offline snapshot 196be9f6-2b7c-480d-9dcc-6b4eb5390877 of volume 593ca080-e6e9-4e8d-bef9-e29a9160e029 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] snapshot_file for this snap is: volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5a6eb5-5360-4d0f-a51d-a103031c9975]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:00 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1ea46bc1-ac45-44e6-a30f-3189bfa62d66 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20" returned: 0 in 0.777s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-1ea46bc1-ac45-44e6-a30f-3189bfa62d66 tempest-VolumesSnapshotListTestJSON-1856966152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89a7e693-972b-4f24-9121-e37f923d3453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:25:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1ea46bc1-ac45-44e6-a30f-3189bfa62d66 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:00 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781 1G Jun 15 07:25:00 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:00 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877 Jun 15 07:25:00 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:01 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877" returned: 0 in 0.767s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:01 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-593ca080-e6e9-4e8d-bef9-e29a9160e029(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:25:01 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[19098c58-2ee0-4002-ba66-eb0e7d9798c7]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:01 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 Jun 15 07:25:01 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:01 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1ea46bc1-ac45-44e6-a30f-3189bfa62d66 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781 1G" returned: 0 in 0.962s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1ea46bc1-ac45-44e6-a30f-3189bfa62d66 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:01 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781 Jun 15 07:25:01 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:02 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572" returned: 0 in 0.804s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-593ca080-e6e9-4e8d-bef9-e29a9160e029(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:25:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:02 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877 Jun 15 07:25:02 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:02 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1ea46bc1-ac45-44e6-a30f-3189bfa62d66 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781" returned: 0 in 0.754s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:02 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-1ea46bc1-ac45-44e6-a30f-3189bfa62d66 tempest-VolumesSnapshotListTestJSON-1856966152 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781 is being set with open permissions: ugo+rw Jun 15 07:25:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1ea46bc1-ac45-44e6-a30f-3189bfa62d66 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:02 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781 Jun 15 07:25:02 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:03 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877" returned: 0 in 1.068s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:03 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1ea46bc1-ac45-44e6-a30f-3189bfa62d66 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781" returned: 0 in 0.935s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:03 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877 Jun 15 07:25:03 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1ea46bc1-ac45-44e6-a30f-3189bfa62d66 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.651s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.985s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-940134036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe38999b-2f8a-4e20-b882-3a87d9dea29e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3ad0365e0d4654be0ba499737768a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:56Z,use_quota=True,user_id='fc52bd02bcd44e30a4d19619e18ba94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:25:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Creating volume fe38999b-2f8a-4e20-b882-3a87d9dea29e {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:25:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:25:03 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:25:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:03 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e 1073741824 Jun 15 07:25:03 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:03 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-1ea46bc1-ac45-44e6-a30f-3189bfa62d66 tempest-VolumesSnapshotListTestJSON-1856966152 None] Create snapshot completed successfully Jun 15 07:25:04 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.196be9f6-2b7c-480d-9dcc-6b4eb5390877" returned: 0 in 0.896s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-196be9f6-2b7c-480d-9dcc-6b4eb5390877" released by "_delete_snapshot" :: held 3.647s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-593ca080-e6e9-4e8d-bef9-e29a9160e029" released by "delete_snapshot" :: held 3.668s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:04 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Created reservations ['aba54c3d-be2e-4ea7-8d18-1e84d27d23ae', '76464835-207b-4440-8527-5f54d4fff2c3', '02c5bd53-f7ff-4f2e-988a-a3e571979eab', 'f5230130-cd53-4608-b8d7-c322486cd571'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:04 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Delete snapshot completed successfully. Jun 15 07:25:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-196be9f6-2b7c-480d-9dcc-6b4eb5390877-delete_snapshot" released by "delete_snapshot" :: held 3.875s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "cinder-7f81024a-157b-46bd-aa44-06bbf3854572-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-7f81024a-157b-46bd-aa44-06bbf3854572-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "cinder-quobyte-593ca080-e6e9-4e8d-bef9-e29a9160e029" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-593ca080-e6e9-4e8d-bef9-e29a9160e029" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "cinder-quobyte-7f81024a-157b-46bd-aa44-06bbf3854572" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-7f81024a-157b-46bd-aa44-06bbf3854572" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Deleting offline snapshot 7f81024a-157b-46bd-aa44-06bbf3854572 of volume 593ca080-e6e9-4e8d-bef9-e29a9160e029 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:25:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] snapshot_file for this snap is: volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:25:04 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ec4ea8-416a-4be3-9423-7db79837da5c]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:04 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 Jun 15 07:25:04 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:04 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e 1073741824" returned: 0 in 1.163s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:05 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e Jun 15 07:25:05 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Acquiring lock "cinder-a2a0a0af-28bd-4700-b387-1ef305d0e781-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-a2a0a0af-28bd-4700-b387-1ef305d0e781-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Acquiring lock "cinder-quobyte-89a7e693-972b-4f24-9121-e37f923d3453" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-quobyte-89a7e693-972b-4f24-9121-e37f923d3453" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Acquiring lock "cinder-quobyte-a2a0a0af-28bd-4700-b387-1ef305d0e781" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-quobyte-a2a0a0af-28bd-4700-b387-1ef305d0e781" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Deleting offline snapshot a2a0a0af-28bd-4700-b387-1ef305d0e781 of volume 89a7e693-972b-4f24-9121-e37f923d3453 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] snapshot_file for this snap is: volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b77bd2c-0fac-4ec1-b25c-7d6f033ba77d]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:05 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572" returned: 0 in 0.916s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-593ca080-e6e9-4e8d-bef9-e29a9160e029(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2ddc84-9bbb-42f9-b62c-cc24b2d66ec4]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:05 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781 Jun 15 07:25:05 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:05 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e" returned: 0 in 0.920s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:05 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029 Jun 15 07:25:05 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:05 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Attempting download of af781faa-2398-41b5-9cb2-cfe0761734f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}])) to volume fe38999b-2f8a-4e20-b882-3a87d9dea29e. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:25:06 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b348337b-afea-4dda-b9c3-bf349c09eaf8]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_blb6sr1_ {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:06 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_blb6sr1_ Jun 15 07:25:06 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:06 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781" returned: 0 in 0.905s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89a7e693-972b-4f24-9121-e37f923d3453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:25:06 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b199ee-a1c0-4f25-a0b3-271fc65e2294]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:06 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029" returned: 0 in 0.787s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:06 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 Jun 15 07:25:06 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:06 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 Jun 15 07:25:06 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:06 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_blb6sr1_" returned: 0 in 0.822s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_blb6sr1_ {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:06 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_blb6sr1_ Jun 15 07:25:06 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:07 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572" returned: 0 in 0.809s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:07 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:07 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572 Jun 15 07:25:07 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20" returned: 0 in 0.882s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89a7e693-972b-4f24-9121-e37f923d3453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:25:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:07 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781 Jun 15 07:25:07 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:07 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_blb6sr1_" returned: 1 in 0.784s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_blb6sr1_' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:25:07 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af2394b-2e5e-4e68-9be0-9c67d5fa3954]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_q52c3qhfdevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:07 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_q52c3qhfdevstack@QuobyteHD Jun 15 07:25:07 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:08 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029.7f81024a-157b-46bd-aa44-06bbf3854572" returned: 0 in 0.686s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-7f81024a-157b-46bd-aa44-06bbf3854572" released by "_delete_snapshot" :: held 3.368s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-593ca080-e6e9-4e8d-bef9-e29a9160e029" released by "delete_snapshot" :: held 3.396s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Created reservations ['d11e1009-4b66-4e00-82c1-12aedab65b68', 'fc818a3f-b136-4d4c-aac7-4a4a272d0b7e', '67f5713f-b112-4561-8054-69cba8d86431', '73c36f86-1aba-4dad-9145-4cb2f5982d58'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:08 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Delete snapshot completed successfully. Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-7f81024a-157b-46bd-aa44-06bbf3854572-delete_snapshot" released by "delete_snapshot" :: held 3.552s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Snapshots deleted, issuing volume delete {{(pid=92129) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "cinder-quobyte-593ca080-e6e9-4e8d-bef9-e29a9160e029" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:08 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781" returned: 0 in 0.838s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-593ca080-e6e9-4e8d-bef9-e29a9160e029" acquired by "delete_volume" :: waited 0.031s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:08 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781 Jun 15 07:25:08 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44cc904-a9e0-40bc-b7a9-95d28bd99cbf]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:08 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_q52c3qhfdevstack@QuobyteHD" returned: 0 in 0.765s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] af781faa-2398-41b5-9cb2-cfe0761734f9 was qcow2, converting to raw {{(pid=92129) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_q52c3qhfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:08 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_q52c3qhfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e Jun 15 07:25:08 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:08 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029 Jun 15 07:25:08 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:08 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.a2a0a0af-28bd-4700-b387-1ef305d0e781" returned: 0 in 0.666s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-quobyte-a2a0a0af-28bd-4700-b387-1ef305d0e781" released by "_delete_snapshot" :: held 3.429s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-quobyte-89a7e693-972b-4f24-9121-e37f923d3453" released by "delete_snapshot" :: held 3.475s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:09 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Created reservations ['4e6fc30c-ad72-4ee1-92de-9fc25aed89b4', '622f696a-efe2-4b9f-98a6-f45bdf84d666', 'ce012628-1d28-4c1f-843a-9f530dbc7351', '2a083663-d2de-4938-b883-e878a436d1b6'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:09 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Delete snapshot completed successfully. Jun 15 07:25:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-421501c8-c653-4b26-a1cc-9cba539a8728 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-a2a0a0af-28bd-4700-b387-1ef305d0e781-delete_snapshot" released by "delete_snapshot" :: held 3.641s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:09 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029" returned: 0 in 0.836s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:09 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029 Jun 15 07:25:09 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Acquiring lock "cinder-980fd937-6ff3-4f3d-849b-957eaccf3e20-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-980fd937-6ff3-4f3d-849b-957eaccf3e20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Acquiring lock "cinder-quobyte-89a7e693-972b-4f24-9121-e37f923d3453" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-quobyte-89a7e693-972b-4f24-9121-e37f923d3453" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Acquiring lock "cinder-quobyte-980fd937-6ff3-4f3d-849b-957eaccf3e20" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-quobyte-980fd937-6ff3-4f3d-849b-957eaccf3e20" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Deleting offline snapshot 980fd937-6ff3-4f3d-849b-957eaccf3e20 of volume 89a7e693-972b-4f24-9121-e37f923d3453 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:25:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] snapshot_file for this snap is: volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:25:09 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:09 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[154b9f1d-6e15-444c-a685-605a310523e9]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-593ca080-e6e9-4e8d-bef9-e29a9160e029" returned: 0 in 0.729s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-593ca080-e6e9-4e8d-bef9-e29a9160e029" released by "delete_volume" :: held 1.661s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:10 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Created reservations ['70685430-4ed3-4683-b0ff-fcd9e58182c9', 'bdabd03b-3640-43a1-a780-bb7b9f6dd7e3', '475ecc85-56cd-474a-8420-1a8ff500a060', 'ccd2a592-20e6-4362-942b-3e4a04b78e61'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:10 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 Jun 15 07:25:10 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:10 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:10 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:10 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:25:10 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "cinder-345e784f-5c90-4ad8-bbf7-566ef68439d9-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:10 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_q52c3qhfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e" returned: 0 in 2.471s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:10 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_q52c3qhfdevstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:25:10 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Converted 112.00 MB image at 45.22 MB/s Jun 15 07:25:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:10 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e 1G Jun 15 07:25:10 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:10 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] Lock "cinder-345e784f-5c90-4ad8-bbf7-566ef68439d9-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.829s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:10 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:10 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Deleted volume successfully. Jun 15 07:25:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f6d82f8a-9606-496c-936f-bc5aa6e39e4d tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-593ca080-e6e9-4e8d-bef9-e29a9160e029-delete_volume" released by "delete_volume" :: held 10.273s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "cinder-quobyte-345e784f-5c90-4ad8-bbf7-566ef68439d9" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] Lock "cinder-quobyte-345e784f-5c90-4ad8-bbf7-566ef68439d9" acquired by "delete_volume" :: waited 0.034s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc93232b-a89b-4569-bd36-4e34d4434425]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-345e784f-5c90-4ad8-bbf7-566ef68439d9 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:11 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20" returned: 0 in 1.223s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89a7e693-972b-4f24-9121-e37f923d3453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6244b14-0d55-4ecf-bbee-a64f0e7ecd98]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:11 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-345e784f-5c90-4ad8-bbf7-566ef68439d9 Jun 15 07:25:11 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:11 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d Jun 15 07:25:11 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Flow 'volume_create_manager' (28e1fc37-a1ee-476d-b8ff-1528d062ab47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c9b07b5-2b63-42a9-90bc-5de870be4595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c9b07b5-2b63-42a9-90bc-5de870be4595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-335590435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d04ceb-0754-4d80-917c-f38e24fafb03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f63a9f2d16149d092ef375ff96a07ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:11Z,use_quota=True,user_id='211ff20613f34d7fbf4e3e9cc3d358ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7667126-4f1a-4711-a029-b7c37b4e0813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7667126-4f1a-4711-a029-b7c37b4e0813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bad1526-fc36-45ac-b3b9-007543829a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bad1526-fc36-45ac-b3b9-007543829a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5d04ceb-0754-4d80-917c-f38e24fafb03', 'volume_name': 'volume-d5d04ceb-0754-4d80-917c-f38e24fafb03', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a9de6e-e396-4cdc-9d4c-c512a10a0838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a9de6e-e396-4cdc-9d4c-c512a10a0838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56fe0d9-d303-4dbe-9527-2e28d090d927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:11 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Volume d5d04ceb-0754-4d80-917c-f38e24fafb03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5d04ceb-0754-4d80-917c-f38e24fafb03', 'volume_size': 1} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-335590435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d04ceb-0754-4d80-917c-f38e24fafb03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f63a9f2d16149d092ef375ff96a07ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:11Z,use_quota=True,user_id='211ff20613f34d7fbf4e3e9cc3d358ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Creating volume d5d04ceb-0754-4d80-917c-f38e24fafb03 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:25:11 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:11 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 1073741824 Jun 15 07:25:11 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:11 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e 1G" returned: 0 in 0.784s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d3c8ad-52a4-4ec6-8908-edb01e99c6db]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:11 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e Jun 15 07:25:11 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:11 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-345e784f-5c90-4ad8-bbf7-566ef68439d9" returned: 0 in 0.841s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-345e784f-5c90-4ad8-bbf7-566ef68439d9 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:11 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-345e784f-5c90-4ad8-bbf7-566ef68439d9 Jun 15 07:25:11 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:12 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d" returned: 0 in 0.986s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:12 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89a7e693-972b-4f24-9121-e37f923d3453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:25:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:12 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 Jun 15 07:25:12 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:12 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 1073741824" returned: 0 in 0.839s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:12 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 Jun 15 07:25:12 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:12 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e" returned: 0 in 0.898s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:12 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-345e784f-5c90-4ad8-bbf7-566ef68439d9" returned: 0 in 0.732s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] Lock "cinder-quobyte-345e784f-5c90-4ad8-bbf7-566ef68439d9" released by "delete_volume" :: held 1.639s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:12 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e Jun 15 07:25:12 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:12 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] Created reservations ['75fee3c2-50de-48cf-9f5c-041753b1c441', '04701472-c13a-420c-a8ce-7a37e267e010', '53dcbf83-5929-4378-96f0-712156f008f0', '4e44d6a1-acde-451b-8a2d-08c03d682af7'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:12 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:12 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:12 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:25:12 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:12 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20" returned: 0 in 0.866s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:13 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20 Jun 15 07:25:13 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "cinder-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:13 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03" returned: 0 in 0.805s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] Lock "cinder-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56fe0d9-d303-4dbe-9527-2e28d090d927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5d04ceb-0754-4d80-917c-f38e24fafb03', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de99a489-5786-435b-927e-86298f1b7f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:13 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Volume volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 (d5d04ceb-0754-4d80-917c-f38e24fafb03): created successfully Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de99a489-5786-435b-927e-86298f1b7f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Flow 'volume_create_manager' (28e1fc37-a1ee-476d-b8ff-1528d062ab47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "cinder-quobyte-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:13 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-7825216c-488f-49da-9c8c-0224e90c9cce tempest-VolumesDeleteCascade-1983287083 None] Created volume successfully. Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] Lock "cinder-quobyte-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c" acquired by "delete_volume" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e9062b-cf08-45d4-8d12-48d604c77c49]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:13 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e" returned: 1 in 0.991s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Downloaded image af781faa-2398-41b5-9cb2-cfe0761734f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}])) to volume fe38999b-2f8a-4e20-b882-3a87d9dea29e successfully. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Temporary image af781faa-2398-41b5-9cb2-cfe0761734f9 for user fc52bd02bcd44e30a4d19619e18ba94d is deleted. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Marking volume fe38999b-2f8a-4e20-b882-3a87d9dea29e as bootable. {{(pid=92129) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:25:13 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c Jun 15 07:25:13 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Copying metadata from image af781faa-2398-41b5-9cb2-cfe0761734f9 to fe38999b-2f8a-4e20-b882-3a87d9dea29e. {{(pid=92129) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Creating volume glance metadata for volume fe38999b-2f8a-4e20-b882-3a87d9dea29e backed by image af781faa-2398-41b5-9cb2-cfe0761734f9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92129) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:25:13 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.920s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:13 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] Deleted volume successfully. Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec28d4d9-96f7-4b1b-807b-9a6a6cc87110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e', 'volume_size': 1, 'image_id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0d4c76bb4c8424fbbbc7d856674ea3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'created_at': datetime.datetime(2026, 6, 15, 5, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af781faa-2398-41b5-9cb2-cfe0761734f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557584de-42c5-4bcb-bccd-362a40e4a3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:13 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Volume volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e (fe38999b-2f8a-4e20-b882-3a87d9dea29e): created successfully Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557584de-42c5-4bcb-bccd-362a40e4a3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Flow 'volume_create_manager' (9fdb4756-633d-4cdb-af13-8e91204def99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9dda246a-be93-4a0c-85d7-42b16a78cb26 tempest-AttachVolumeTestJSON-1407893396 None] Lock "cinder-345e784f-5c90-4ad8-bbf7-566ef68439d9-delete_volume" released by "delete_volume" :: held 2.930s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:13 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-69ec3dc0-bb6f-41c8-9c86-5fad80ec3349 tempest-VolumesExtendTest-915029703 None] Created volume successfully. Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] Creating offline snapshot 0c3fe71e-4ede-468a-bbe5-b8e69b8b679e of volume d5d04ceb-0754-4d80-917c-f38e24fafb03 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:25:13 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0c7456-1ab4-4cd5-92f4-5f77de7ce820]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.980fd937-6ff3-4f3d-849b-957eaccf3e20" returned: 0 in 0.973s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:13 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:25:13 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:14 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-quobyte-980fd937-6ff3-4f3d-849b-957eaccf3e20" released by "_delete_snapshot" :: held 4.173s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:14 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-quobyte-89a7e693-972b-4f24-9121-e37f923d3453" released by "delete_snapshot" :: held 4.200s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:14 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 Jun 15 07:25:14 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:14 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Created reservations ['7b7f7998-2467-48e2-a4b7-462ee0ee2202', 'cda6ce08-8f54-442e-88c9-20e35bdeb88c', 'a40743bc-66df-4e03-b864-b288e1045011', 'cbd3d830-8ba4-4cb3-b810-a77b714f88f8'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:14 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Delete snapshot completed successfully. Jun 15 07:25:14 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4ffe5843-3da1-4a63-9316-526336558e06 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-980fd937-6ff3-4f3d-849b-957eaccf3e20-delete_snapshot" released by "delete_snapshot" :: held 4.431s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:14 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c" returned: 0 in 1.009s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:14 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c Jun 15 07:25:14 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:14 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.706s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:14 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:14 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:25:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 28 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:25:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:25:14 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03" returned: 0 in 0.812s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-568e5461-6bb4-4ea2-8002-261f0bd2d468 tempest-VolumesExtendTest-915029703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:14 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e 1G Jun 15 07:25:14 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] Acquiring lock "cinder-0972af58-d305-4b38-9080-259af758661d-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-0972af58-d305-4b38-9080-259af758661d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] Acquiring lock "cinder-quobyte-89a7e693-972b-4f24-9121-e37f923d3453" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:15 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c" returned: 0 in 0.693s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-quobyte-89a7e693-972b-4f24-9121-e37f923d3453" acquired by "delete_snapshot" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] Acquiring lock "cinder-quobyte-0972af58-d305-4b38-9080-259af758661d" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] Lock "cinder-quobyte-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c" released by "delete_volume" :: held 1.784s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-quobyte-0972af58-d305-4b38-9080-259af758661d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] Deleting offline snapshot 0972af58-d305-4b38-9080-259af758661d of volume 89a7e693-972b-4f24-9121-e37f923d3453 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] snapshot_file for this snap is: volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13c5984-0c4d-41c4-8239-51ca71fa6643]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] Created reservations ['9db37188-81e0-425f-bc12-9823ee003b89', '6c86ad61-207a-4011-af75-db85409763db', '56c919a2-1ee2-432c-9a1e-99f22805672b', '362bc2ef-85cc-4f5d-ba51-30369156d024'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:15 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d Jun 15 07:25:15 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:15 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:25:15 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "cinder-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] Lock "cinder-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "cinder-quobyte-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] Lock "cinder-quobyte-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d" acquired by "delete_volume" :: waited 0.022s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:15 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e 1G" returned: 0 in 1.009s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ddb554-fd77-4f43-9ddb-5d47abd02caa]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:15 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e Jun 15 07:25:15 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:15 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d Jun 15 07:25:15 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:16 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d" returned: 0 in 0.835s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89a7e693-972b-4f24-9121-e37f923d3453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:25:16 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2671780-6515-4a25-9c61-fd7eaa1f7826]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:16 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.752s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:16 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:16 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] Deleted volume successfully. Jun 15 07:25:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-16ee6a52-8c73-4906-8acf-7f5dc8793b40 tempest-AttachVolumeTestJSON-1407893396 None] Lock "cinder-5e31623b-7db2-4a5a-85d6-65ba7b66ac8c-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:16 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453 Jun 15 07:25:16 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:16 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d" returned: 0 in 0.782s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:16 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e" returned: 0 in 0.816s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:16 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e is being set with open permissions: ugo+rw Jun 15 07:25:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:16 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d Jun 15 07:25:16 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:16 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e Jun 15 07:25:16 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:16 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453" returned: 0 in 0.773s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:16 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d Jun 15 07:25:16 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:17 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d" returned: 0 in 0.622s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] Lock "cinder-quobyte-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d" released by "delete_volume" :: held 1.469s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:17 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] Created reservations ['2356608d-ce5e-4f22-92e9-0f146785f3af', '17006b08-45f3-4baa-a398-32e8a331e40e', '68efb509-fc00-43cf-9dd1-fe1997f4f7da', 'b6dfe98a-22a7-4b50-a20f-6f65533bdace'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:17 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e" returned: 0 in 0.713s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:17 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.info Jun 15 07:25:17 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:17 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:25:17 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:17 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d" returned: 0 in 0.763s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:17 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d Jun 15 07:25:17 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:18 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.596s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:18 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:18 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:18 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] Deleted volume successfully. Jun 15 07:25:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.info" returned: 0 in 0.661s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:18 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.info is being set with open permissions: ugo+rw Jun 15 07:25:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:18 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.info Jun 15 07:25:18 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:18 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-83d47e55-3d3b-4ab5-ae3f-8e8e9caa8478 tempest-AttachVolumeTestJSON-1407893396 None] Lock "cinder-5e75b0b7-df8b-4e7e-b40e-2eea0e20241d-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:18 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453.0972af58-d305-4b38-9080-259af758661d" returned: 0 in 0.687s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:18 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-quobyte-0972af58-d305-4b38-9080-259af758661d" released by "_delete_snapshot" :: held 3.174s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:18 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-quobyte-89a7e693-972b-4f24-9121-e37f923d3453" released by "delete_snapshot" :: held 3.203s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:18 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] Created reservations ['5de8cb97-5c8f-47a4-8c68-ae75222463bf', '34376b46-227d-44fe-ade7-d11ce3294389', 'ec19fa65-2c21-40ca-ba71-3c0d03b6ec27', 'e41e4ecf-2541-4b2c-bd74-4521792ab61f'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:18 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] Delete snapshot completed successfully. Jun 15 07:25:18 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5f111c9a-7c2c-425a-bb22-b415e07fb943 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-0972af58-d305-4b38-9080-259af758661d-delete_snapshot" released by "delete_snapshot" :: held 3.357s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:18 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.info" returned: 0 in 0.653s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.803s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-568e5461-6bb4-4ea2-8002-261f0bd2d468 tempest-VolumesExtendTest-915029703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.915s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:18 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c0f143a9-22ce-4e17-9216-e0380a2feff3 tempest-VolumesDeleteCascade-1983287083 None] Create snapshot completed successfully Jun 15 07:25:18 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1454e1f7-7594-4d0a-b2cf-a5c99ba7a798]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-568e5461-6bb4-4ea2-8002-261f0bd2d468 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:18 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e Jun 15 07:25:18 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] Acquiring lock "cinder-89a7e693-972b-4f24-9121-e37f923d3453-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-89a7e693-972b-4f24-9121-e37f923d3453-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:19 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-568e5461-6bb4-4ea2-8002-261f0bd2d468 tempest-VolumesExtendTest-915029703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e" returned: 0 in 0.819s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-568e5461-6bb4-4ea2-8002-261f0bd2d468 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] Acquiring lock "cinder-quobyte-89a7e693-972b-4f24-9121-e37f923d3453" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-quobyte-89a7e693-972b-4f24-9121-e37f923d3453" acquired by "delete_volume" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:19 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e Jun 15 07:25:19 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f2f5c8-041a-4dd5-bbbe-cfc46cbb70be]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Flow 'volume_create_manager' (031ee937-6af1-4717-94b0-463881a8d7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89aa324b-86d1-4b7d-8f70-adeed34b936a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89aa324b-86d1-4b7d-8f70-adeed34b936a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1355597782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc135d0-2c1a-4afb-8966-7649a4badd7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f63a9f2d16149d092ef375ff96a07ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0c3fe71e-4ede-468a-bbe5-b8e69b8b679e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:20Z,use_quota=True,user_id='211ff20613f34d7fbf4e3e9cc3d358ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aefe086-9e0f-40cd-9977-30e4d52796cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aefe086-9e0f-40cd-9977-30e4d52796cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364d7511-eda3-4274-b80b-0d1c1f73ffa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:19 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453 Jun 15 07:25:19 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364d7511-eda3-4274-b80b-0d1c1f73ffa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ebc135d0-2c1a-4afb-8966-7649a4badd7c', 'volume_name': 'volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c', 'volume_size': 1, 'snapshot_id': '0c3fe71e-4ede-468a-bbe5-b8e69b8b679e'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9608dd33-5fde-4781-8f5c-ff06dd8aaeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9608dd33-5fde-4781-8f5c-ff06dd8aaeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045a5f76-624d-4fe7-b540-4f40dcc2b7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:19 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Volume ebc135d0-2c1a-4afb-8966-7649a4badd7c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c', 'volume_size': 1, 'snapshot_id': '0c3fe71e-4ede-468a-bbe5-b8e69b8b679e'} Jun 15 07:25:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:20 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-568e5461-6bb4-4ea2-8002-261f0bd2d468 tempest-VolumesExtendTest-915029703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e" returned: 1 in 0.796s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-568e5461-6bb4-4ea2-8002-261f0bd2d468 tempest-VolumesExtendTest-915029703 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-568e5461-6bb4-4ea2-8002-261f0bd2d468 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e 2G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-568e5461-6bb4-4ea2-8002-261f0bd2d468 tempest-VolumesExtendTest-915029703 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e 2G" returned: 0 in 0.088s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-568e5461-6bb4-4ea2-8002-261f0bd2d468 tempest-VolumesExtendTest-915029703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.758s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.589s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "cinder-quobyte-0c3fe71e-4ede-468a-bbe5-b8e69b8b679e-ebc135d0-2c1a-4afb-8966-7649a4badd7c" by "_create_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-0c3fe71e-4ede-468a-bbe5-b8e69b8b679e-ebc135d0-2c1a-4afb-8966-7649a4badd7c" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Creating volume ebc135d0-2c1a-4afb-8966-7649a4badd7c from snapshot 0c3fe71e-4ede-468a-bbe5-b8e69b8b679e {{(pid=92129) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "cinder-quobyte-ebc135d0-2c1a-4afb-8966-7649a4badd7c" by "_copy_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:20 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453" returned: 0 in 0.816s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-ebc135d0-2c1a-4afb-8966-7649a4badd7c" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] snapshot: 0c3fe71e-4ede-468a-bbe5-b8e69b8b679e, volume: ebc135d0-2c1a-4afb-8966-7649a4badd7c, {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:25:20 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453 Jun 15 07:25:20 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:20 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-568e5461-6bb4-4ea2-8002-261f0bd2d468 tempest-VolumesExtendTest-915029703 None] Extend volume completed successfully. Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a647cb-12b9-415e-beac-a259975e65c1]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:20 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e Jun 15 07:25:20 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:21 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-89a7e693-972b-4f24-9121-e37f923d3453" returned: 0 in 0.713s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-quobyte-89a7e693-972b-4f24-9121-e37f923d3453" released by "delete_volume" :: held 1.630s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] Created reservations ['45c9d9c4-281b-4ea1-bd19-46eae9e19fe0', '07768093-fccc-4479-805e-decbfbec2121', '8e6869f7-447e-4524-9311-bb468d3115e5', '4046d48c-0a72-4e21-a0b9-40b21a7de77e'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:21 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:25:21 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Acquiring lock "cinder-fe38999b-2f8a-4e20-b882-3a87d9dea29e-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Lock "cinder-fe38999b-2f8a-4e20-b882-3a87d9dea29e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:21 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e" returned: 0 in 0.891s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5d04ceb-0754-4d80-917c-f38e24fafb03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Creating direct copy from snapshot {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9056cf-46a5-4860-b3a0-ecc30deba0c3]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Acquiring lock "cinder-quobyte-fe38999b-2f8a-4e20-b882-3a87d9dea29e" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Lock "cinder-quobyte-fe38999b-2f8a-4e20-b882-3a87d9dea29e" acquired by "delete_volume" :: waited 0.022s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab08c34-2a33-4e1f-a5f4-856ad300dc27]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:21 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 Jun 15 07:25:21 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:21 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e Jun 15 07:25:21 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:22 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.029s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:22 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:22 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] Deleted volume successfully. Jun 15 07:25:22 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=139,cinder:INSERT=45,cinder:UPDATE=158,cinder:DELETE=13 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:25:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-efcbcbd3-5d91-43dd-9d8c-bfb6850eddf1 tempest-VolumesSnapshotListTestJSON-1856966152 None] Lock "cinder-89a7e693-972b-4f24-9121-e37f923d3453-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:22 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03" returned: 0 in 1.008s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:22 devstack cinder-volume[92129]: DEBUG cinder.utils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Path /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c not found in is_blk_device check {{(pid=92129) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:25:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:22 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c Jun 15 07:25:22 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:22 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e" returned: 0 in 1.126s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:22 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e Jun 15 07:25:22 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:24 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e" returned: 1 in 1.293s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:25:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:24 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e Jun 15 07:25:24 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:25 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fe38999b-2f8a-4e20-b882-3a87d9dea29e" returned: 0 in 1.182s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:25 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Lock "cinder-quobyte-fe38999b-2f8a-4e20-b882-3a87d9dea29e" released by "delete_volume" :: held 3.726s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:25 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:INSERT=39,cinder:UPDATE=135,cinder:SELECT=126,cinder:DELETE=11 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:25:25 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Created reservations ['1820d5a4-be5a-479a-84f4-abd911874251', '0d129b01-3069-4e28-8190-99d10ef34d29', 'e3f043a2-24ca-4724-9fc2-86fc9b1a77da', '5322c3d5-54b9-4b7b-ab60-b4e3797dc956'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:25 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:25:25 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:26 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.052s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:26 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:26 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Deleted volume successfully. Jun 15 07:25:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8d2a8a37-81f2-4b28-8427-df38e7263da2 tempest-VolumesExtendTest-915029703 None] Lock "cinder-fe38999b-2f8a-4e20-b882-3a87d9dea29e-delete_volume" released by "delete_volume" :: held 5.374s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:27 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:25:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Flow 'volume_create_manager' (2e4aebc0-d6f4-4882-aa53-3566eb4464be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbae653-8ba1-4ad7-a9bc-d5315034bf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbae653-8ba1-4ad7-a9bc-d5315034bf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1914115330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3ad0365e0d4654be0ba499737768a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:27Z,use_quota=True,user_id='fc52bd02bcd44e30a4d19619e18ba94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d03d389-af92-421c-adba-c18f38344be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d03d389-af92-421c-adba-c18f38344be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a01902-5060-47d5-888d-1e432d025dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a01902-5060-47d5-888d-1e432d025dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3', 'volume_name': 'volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62045fe-6e67-4861-8ab0-b18d783b9b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62045fe-6e67-4861-8ab0-b18d783b9b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e988e4-23dc-4008-aee1-48cb4878628f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:27 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Volume 30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3', 'volume_size': 1} Jun 15 07:25:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:29 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c" returned: 0 in 6.432s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e22f8f9-f769-494b-8a53-8e352822adaa]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:29 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 Jun 15 07:25:29 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Flow 'volume_create_manager' (bf90de2c-7669-4403-9c3b-874475268551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218e913d-e713-4640-a51a-ce9c3b3b7f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218e913d-e713-4640-a51a-ce9c3b3b7f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1648038653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3df48eb-10c4-4216-afcd-978c48346abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c219e4374f144b6cbb0f5202dea8d848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:29Z,use_quota=True,user_id='2ffb8f261f494fe5ad6c8f6a422c2314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5478e0ea-0cc6-4736-8a9b-e078d304eea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5478e0ea-0cc6-4736-8a9b-e078d304eea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fcf370-bcda-4fda-b88e-63d7cc4f8c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fcf370-bcda-4fda-b88e-63d7cc4f8c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3df48eb-10c4-4216-afcd-978c48346abf', 'volume_name': 'volume-f3df48eb-10c4-4216-afcd-978c48346abf', 'volume_size': 2}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ef4206-af6e-4b23-8d2c-fbfb1bfc75a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ef4206-af6e-4b23-8d2c-fbfb1bfc75a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd93895-2abb-4f3a-a546-f54361f9632a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:29 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Volume f3df48eb-10c4-4216-afcd-978c48346abf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3df48eb-10c4-4216-afcd-978c48346abf', 'volume_size': 2} Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:29 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03" returned: 0 in 0.938s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Image conversion details: src /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:25:29 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Converted 1024.00 MB image at 159.18 MB/s Jun 15 07:25:29 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c is being set with open permissions: ugo+rw Jun 15 07:25:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:29 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c Jun 15 07:25:29 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:30 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c" returned: 0 in 0.657s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-ebc135d0-2c1a-4afb-8966-7649a4badd7c" released by "_copy_volume_from_snapshot" :: held 10.052s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-0c3fe71e-4ede-468a-bbe5-b8e69b8b679e-ebc135d0-2c1a-4afb-8966-7649a4badd7c" released by "_create_volume_from_snapshot" :: held 10.111s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.158s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.038s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1914115330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3ad0365e0d4654be0ba499737768a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:27Z,use_quota=True,user_id='fc52bd02bcd44e30a4d19619e18ba94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Creating volume 30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:25:30 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:30 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 1073741824 Jun 15 07:25:30 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045a5f76-624d-4fe7-b540-4f40dcc2b7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c', 'volume_size': 1, 'snapshot_id': '0c3fe71e-4ede-468a-bbe5-b8e69b8b679e'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c741676a-2e14-4561-bb37-f70d6a6bc8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:30 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Volume volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c (ebc135d0-2c1a-4afb-8966-7649a4badd7c): created successfully Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c741676a-2e14-4561-bb37-f70d6a6bc8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Flow 'volume_create_manager' (031ee937-6af1-4717-94b0-463881a8d7ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:30 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-ed644681-0ddb-49ac-808f-b32d4094977c tempest-VolumesDeleteCascade-1983287083 None] Created volume successfully. Jun 15 07:25:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "cinder-d5d04ceb-0754-4d80-917c-f38e24fafb03-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-d5d04ceb-0754-4d80-917c-f38e24fafb03-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Performing cascade delete. {{(pid=92129) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 15 07:25:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "cinder-0c3fe71e-4ede-468a-bbe5-b8e69b8b679e-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-0c3fe71e-4ede-468a-bbe5-b8e69b8b679e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "cinder-quobyte-d5d04ceb-0754-4d80-917c-f38e24fafb03" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-d5d04ceb-0754-4d80-917c-f38e24fafb03" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "cinder-quobyte-0c3fe71e-4ede-468a-bbe5-b8e69b8b679e" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-0c3fe71e-4ede-468a-bbe5-b8e69b8b679e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Deleting offline snapshot 0c3fe71e-4ede-468a-bbe5-b8e69b8b679e of volume d5d04ceb-0754-4d80-917c-f38e24fafb03 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:25:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] snapshot_file for this snap is: volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:25:31 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d364e5b3-2075-4bd5-b012-571bacbe63fd]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:31 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e Jun 15 07:25:31 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:31 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 1073741824" returned: 0 in 0.932s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:31 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 Jun 15 07:25:31 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:32 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e" returned: 0 in 0.856s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5d04ceb-0754-4d80-917c-f38e24fafb03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a841f41-87be-4d64-8b66-b910ed2e9ddd]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:32 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3" returned: 0 in 0.742s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.125s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1648038653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3df48eb-10c4-4216-afcd-978c48346abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c219e4374f144b6cbb0f5202dea8d848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:29Z,use_quota=True,user_id='2ffb8f261f494fe5ad6c8f6a422c2314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Creating volume f3df48eb-10c4-4216-afcd-978c48346abf {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:25:32 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf 2147483648 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e988e4-23dc-4008-aee1-48cb4878628f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:32 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 Jun 15 07:25:32 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebaac24-58ff-403f-8a13-8f50229c9f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:32 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf 2147483648 Jun 15 07:25:32 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:32 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Volume volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 (30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3): created successfully Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebaac24-58ff-403f-8a13-8f50229c9f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Flow 'volume_create_manager' (2e4aebc0-d6f4-4882-aa53-3566eb4464be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:32 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-891f54c3-9b2f-4dcb-953e-12bf7a82176c tempest-VolumesExtendTest-915029703 None] Created volume successfully. Jun 15 07:25:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:33 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03" returned: 0 in 0.928s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:33 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e Jun 15 07:25:33 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:33 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf 2147483648" returned: 0 in 1.092s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:33 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf Jun 15 07:25:33 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:34 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e" returned: 0 in 0.847s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:34 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e Jun 15 07:25:34 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:34 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf" returned: 0 in 0.698s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:25:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.055s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd93895-2abb-4f3a-a546-f54361f9632a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3df48eb-10c4-4216-afcd-978c48346abf', 'volume_size': 2}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2debb887-169c-4958-97b1-244d7c62a0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] Creating offline snapshot 50b3b40d-cb05-4141-9255-19eaf2a113ad of volume 30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:25:34 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Volume volume-f3df48eb-10c4-4216-afcd-978c48346abf (f3df48eb-10c4-4216-afcd-978c48346abf): created successfully Jun 15 07:25:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2debb887-169c-4958-97b1-244d7c62a0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Flow 'volume_create_manager' (bf90de2c-7669-4403-9c3b-874475268551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:34 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44dbe66-c654-4069-af78-9f7fe9513d39]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:34 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-70a9d560-9862-4aa7-a2a0-5561e270833b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Created volume successfully. Jun 15 07:25:34 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 Jun 15 07:25:34 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:34 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03.0c3fe71e-4ede-468a-bbe5-b8e69b8b679e" returned: 0 in 0.612s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-0c3fe71e-4ede-468a-bbe5-b8e69b8b679e" released by "_delete_snapshot" :: held 3.380s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-d5d04ceb-0754-4d80-917c-f38e24fafb03" released by "delete_snapshot" :: held 3.418s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:34 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Created reservations ['741c97d5-e6c6-4e54-8629-4e3c5346eead', 'f92d1b6f-ee1c-41a0-987e-a9e9534d1802', '49511904-01b4-4171-a214-5ab09b67f651', 'd1e3dad6-0e8b-47f1-a020-93f645c48668'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:34 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Delete snapshot completed successfully. Jun 15 07:25:35 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-0c3fe71e-4ede-468a-bbe5-b8e69b8b679e-delete_snapshot" released by "delete_snapshot" :: held 3.661s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Snapshots deleted, issuing volume delete {{(pid=92129) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 15 07:25:35 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "cinder-quobyte-d5d04ceb-0754-4d80-917c-f38e24fafb03" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:35 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-d5d04ceb-0754-4d80-917c-f38e24fafb03" acquired by "delete_volume" :: waited 0.040s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:35 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fddf0e-8286-4226-bd62-57521ee17d11]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:35 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3" returned: 0 in 0.881s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:35 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad 1G Jun 15 07:25:35 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:35 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 Jun 15 07:25:35 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:35 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03" returned: 0 in 0.801s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:35 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03 Jun 15 07:25:35 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:35 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad 1G" returned: 0 in 0.783s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:36 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad Jun 15 07:25:36 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:36 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d5d04ceb-0754-4d80-917c-f38e24fafb03" returned: 0 in 0.661s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-d5d04ceb-0754-4d80-917c-f38e24fafb03" released by "delete_volume" :: held 1.566s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:36 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad" returned: 0 in 0.683s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:36 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad is being set with open permissions: ugo+rw Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Created reservations ['034c37f2-a930-4f5e-827a-328f237fff9b', '170968af-02f6-4e64-b455-cc4f99f63b11', 'b4ac49df-d6ff-4c2c-8408-f231169dac57', '37113718-e5c8-48a5-bfc4-70cc29cb1478'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:36 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad Jun 15 07:25:36 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:36 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:25:36 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Flow 'volume_create_manager' (bf582f6b-6fe6-484f-bd10-4c68b1ac750d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69548bed-3045-4678-a30c-afd90331797f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69548bed-3045-4678-a30c-afd90331797f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1245439829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bce46d-1747-4a65-b7fb-a2a660fc9bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ad9c23ef08434a9e34dc6de115c0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:37Z,use_quota=True,user_id='6613c93128c44ae5b9f73fb54422197b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73a0af98-8905-40ff-9c33-92381dae5451),volume_type_id=73a0af98-8905-40ff-9c33-92381dae5451)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ab427c-f52d-49e2-8216-774ba3de37f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ab427c-f52d-49e2-8216-774ba3de37f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48fdcf08-e540-44e4-8acb-17c76697c1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48fdcf08-e540-44e4-8acb-17c76697c1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21bce46d-1747-4a65-b7fb-a2a660fc9bc2', 'volume_name': 'volume-21bce46d-1747-4a65-b7fb-a2a660fc9bc2', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ddb30c9-e33b-414c-a519-cad25dd4a4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ddb30c9-e33b-414c-a519-cad25dd4a4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acf51a3-8853-47a8-b3c2-4da69395d6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:36 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Volume 21bce46d-1747-4a65-b7fb-a2a660fc9bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21bce46d-1747-4a65-b7fb-a2a660fc9bc2', 'volume_size': 1} Jun 15 07:25:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:37 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad" returned: 0 in 0.683s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:37 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.info Jun 15 07:25:37 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:37 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.714s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:37 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:37 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Deleted volume successfully. Jun 15 07:25:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2d6ed75a-986c-4e79-9b4e-7dfff3270da3 tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-d5d04ceb-0754-4d80-917c-f38e24fafb03-delete_volume" released by "delete_volume" :: held 6.291s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "cinder-ebc135d0-2c1a-4afb-8966-7649a4badd7c-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-ebc135d0-2c1a-4afb-8966-7649a4badd7c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "cinder-quobyte-ebc135d0-2c1a-4afb-8966-7649a4badd7c" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-ebc135d0-2c1a-4afb-8966-7649a4badd7c" acquired by "delete_volume" :: waited 0.020s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:38 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacf561d-810f-454a-b29f-f5dd62cdbd79]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:38 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.info" returned: 0 in 0.711s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:38 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.info is being set with open permissions: ugo+rw Jun 15 07:25:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:38 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.info Jun 15 07:25:38 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:38 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c Jun 15 07:25:38 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:38 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.info" returned: 0 in 0.603s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.471s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.510s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:38 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c" returned: 0 in 0.733s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Creating offline snapshot 70a2d9ac-ed10-40e6-9f1e-2096972ef3b4 of volume f3df48eb-10c4-4216-afcd-978c48346abf {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:25:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:38 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-8bb311ec-3bd5-4bd8-b7d9-377bcc3f8ed6 tempest-VolumesExtendTest-915029703 None] Create snapshot completed successfully Jun 15 07:25:38 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[030b4648-ffb0-4131-ae56-f2f1c2679b02]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:38 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c Jun 15 07:25:38 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:38 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf Jun 15 07:25:38 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:39 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebc135d0-2c1a-4afb-8966-7649a4badd7c" returned: 0 in 0.610s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-quobyte-ebc135d0-2c1a-4afb-8966-7649a4badd7c" released by "delete_volume" :: held 1.395s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:39 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] Created reservations ['1c25ae43-5de0-4f61-81f7-f3a7c3fd9368', '71cb2508-0a29-46e5-a7fa-dc9d21ce9687', 'd98af60e-8a39-4615-92a1-b760294e14c1', 'aac55d66-9173-4e51-8474-24f323027173'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:39 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:25:39 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:39 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf" returned: 0 in 0.761s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4 2G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f3a0ca63-88ac-4f25-921f-075c748e8738 tempest-VolumesExtendTest-915029703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:39 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4 2G Jun 15 07:25:39 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:40 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.630s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:40 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:40 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] Deleted volume successfully. Jun 15 07:25:40 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a07afdfd-5df0-42cd-a8aa-ba9064fee779 tempest-VolumesDeleteCascade-1983287083 None] Lock "cinder-ebc135d0-2c1a-4afb-8966-7649a4badd7c-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:40 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4 2G" returned: 0 in 0.788s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3df48eb-10c4-4216-afcd-978c48346abf -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:40 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3df48eb-10c4-4216-afcd-978c48346abf -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4 Jun 15 07:25:40 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:40 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3df48eb-10c4-4216-afcd-978c48346abf -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4" returned: 0 in 0.647s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:40 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4 is being set with open permissions: ugo+rw Jun 15 07:25:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:41 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4 Jun 15 07:25:41 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:41 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4" returned: 0 in 0.672s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:41 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.info Jun 15 07:25:41 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:42 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.info" returned: 0 in 0.645s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:42 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.info is being set with open permissions: ugo+rw Jun 15 07:25:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:42 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.info Jun 15 07:25:42 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:42 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.info" returned: 0 in 0.614s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.244s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.041s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1245439829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bce46d-1747-4a65-b7fb-a2a660fc9bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ad9c23ef08434a9e34dc6de115c0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:37Z,use_quota=True,user_id='6613c93128c44ae5b9f73fb54422197b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73a0af98-8905-40ff-9c33-92381dae5451),volume_type_id=73a0af98-8905-40ff-9c33-92381dae5451)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:25:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Creating volume 21bce46d-1747-4a65-b7fb-a2a660fc9bc2 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:25:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:25:42 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:25:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-21bce46d-1747-4a65-b7fb-a2a660fc9bc2 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:43 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-21bce46d-1747-4a65-b7fb-a2a660fc9bc2 1073741824 Jun 15 07:25:43 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:43 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-da6ca49a-afcf-463b-81c1-1aa7ff168c7b tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Create snapshot completed successfully Jun 15 07:25:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Acquiring lock "cinder-70a2d9ac-ed10-40e6-9f1e-2096972ef3b4-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "cinder-70a2d9ac-ed10-40e6-9f1e-2096972ef3b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Acquiring lock "cinder-quobyte-f3df48eb-10c4-4216-afcd-978c48346abf" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "cinder-quobyte-f3df48eb-10c4-4216-afcd-978c48346abf" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Acquiring lock "cinder-quobyte-70a2d9ac-ed10-40e6-9f1e-2096972ef3b4" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "cinder-quobyte-70a2d9ac-ed10-40e6-9f1e-2096972ef3b4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Deleting offline snapshot 70a2d9ac-ed10-40e6-9f1e-2096972ef3b4 of volume f3df48eb-10c4-4216-afcd-978c48346abf {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:25:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] snapshot_file for this snap is: volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:25:43 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ee3dbe-aab6-42ce-a9b8-0fe807d2c184]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:43 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4 Jun 15 07:25:43 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:43 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-21bce46d-1747-4a65-b7fb-a2a660fc9bc2 1073741824" returned: 0 in 0.960s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-21bce46d-1747-4a65-b7fb-a2a660fc9bc2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:44 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-21bce46d-1747-4a65-b7fb-a2a660fc9bc2 Jun 15 07:25:44 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:44 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4" returned: 0 in 0.837s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3df48eb-10c4-4216-afcd-978c48346abf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa798f0-5e92-46d7-b35e-6360086d9a45]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:44 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-21bce46d-1747-4a65-b7fb-a2a660fc9bc2" returned: 0 in 0.650s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f3a0ca63-88ac-4f25-921f-075c748e8738 tempest-VolumesExtendTest-915029703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 5.076s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acf51a3-8853-47a8-b3c2-4da69395d6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21bce46d-1747-4a65-b7fb-a2a660fc9bc2', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e72cfd-9dc2-4d87-bd8e-71835f431765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7986046-eca9-4cc0-a7bc-860811e190b4]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f3a0ca63-88ac-4f25-921f-075c748e8738 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:44 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Volume volume-21bce46d-1747-4a65-b7fb-a2a660fc9bc2 (21bce46d-1747-4a65-b7fb-a2a660fc9bc2): created successfully Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e72cfd-9dc2-4d87-bd8e-71835f431765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Flow 'volume_create_manager' (bf582f6b-6fe6-484f-bd10-4c68b1ac750d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:44 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-b555223f-8aff-401a-bba9-c3c0c37e0364 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Created volume successfully. Jun 15 07:25:44 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf Jun 15 07:25:44 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Flow 'volume_create_manager' (e27d1617-9a13-471a-ac14-2d864daf82f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fad4578-0775-4f98-933f-8f44530beb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:44 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 Jun 15 07:25:44 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fad4578-0775-4f98-933f-8f44530beb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-663023706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7878a17a-a0da-42f4-bdcc-39541c6dce32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc9c88e8175d40bd98a13122631b7d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:45Z,use_quota=True,user_id='8822ef258db2411a9a54fac9ded8e201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8baf77-e603-42ab-a53f-ca280449abf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8baf77-e603-42ab-a53f-ca280449abf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de7a0f8-7f4c-4e47-b044-455792bf560d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de7a0f8-7f4c-4e47-b044-455792bf560d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7878a17a-a0da-42f4-bdcc-39541c6dce32', 'volume_name': 'volume-7878a17a-a0da-42f4-bdcc-39541c6dce32', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23152fbf-af21-463f-aea7-312ac952b5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23152fbf-af21-463f-aea7-312ac952b5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b45a66a-5266-44f7-9a78-6eda4bf4c576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:44 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Volume 7878a17a-a0da-42f4-bdcc-39541c6dce32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7878a17a-a0da-42f4-bdcc-39541c6dce32', 'volume_size': 1} Jun 15 07:25:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:45 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf" returned: 0 in 0.813s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:45 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4 Jun 15 07:25:45 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:45 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f3a0ca63-88ac-4f25-921f-075c748e8738 tempest-VolumesExtendTest-915029703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3" returned: 0 in 0.809s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f3a0ca63-88ac-4f25-921f-075c748e8738 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad 2G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f3a0ca63-88ac-4f25-921f-075c748e8738 tempest-VolumesExtendTest-915029703 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad 2G" returned: 0 in 0.175s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f3a0ca63-88ac-4f25-921f-075c748e8738 tempest-VolumesExtendTest-915029703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.048s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.818s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-663023706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7878a17a-a0da-42f4-bdcc-39541c6dce32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc9c88e8175d40bd98a13122631b7d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:45Z,use_quota=True,user_id='8822ef258db2411a9a54fac9ded8e201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Creating volume 7878a17a-a0da-42f4-bdcc-39541c6dce32 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:25:45 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7878a17a-a0da-42f4-bdcc-39541c6dce32 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:45 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7878a17a-a0da-42f4-bdcc-39541c6dce32 1073741824 Jun 15 07:25:45 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:45 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f3a0ca63-88ac-4f25-921f-075c748e8738 tempest-VolumesExtendTest-915029703 None] Extend volume completed successfully. Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7e8f4ddb-3e08-49db-98e6-99a7aae768e7 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7e8f4ddb-3e08-49db-98e6-99a7aae768e7 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7e8f4ddb-3e08-49db-98e6-99a7aae768e7 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7e8f4ddb-3e08-49db-98e6-99a7aae768e7 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7e8f4ddb-3e08-49db-98e6-99a7aae768e7 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7e8f4ddb-3e08-49db-98e6-99a7aae768e7 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:45 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:25:45 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] Acquiring lock "cinder-50b3b40d-cb05-4141-9255-19eaf2a113ad-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:46 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4" returned: 0 in 0.785s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] Lock "cinder-50b3b40d-cb05-4141-9255-19eaf2a113ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] Acquiring lock "cinder-quobyte-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:46 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4 Jun 15 07:25:46 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] Lock "cinder-quobyte-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] Acquiring lock "cinder-quobyte-50b3b40d-cb05-4141-9255-19eaf2a113ad" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] Lock "cinder-quobyte-50b3b40d-cb05-4141-9255-19eaf2a113ad" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:46 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] Deleting offline snapshot 50b3b40d-cb05-4141-9255-19eaf2a113ad of volume 30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:25:46 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] snapshot_file for this snap is: volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:25:46 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c89c095-99d0-41d7-b7db-38b87061471f]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:46 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad Jun 15 07:25:46 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:46 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7e8f4ddb-3e08-49db-98e6-99a7aae768e7 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.651s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:46 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-7e8f4ddb-3e08-49db-98e6-99a7aae768e7 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:46 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-7e8f4ddb-3e08-49db-98e6-99a7aae768e7 tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Retype volume completed successfully. Jun 15 07:25:46 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7878a17a-a0da-42f4-bdcc-39541c6dce32 1073741824" returned: 0 in 0.895s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7878a17a-a0da-42f4-bdcc-39541c6dce32 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:46 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7878a17a-a0da-42f4-bdcc-39541c6dce32 Jun 15 07:25:46 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:46 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf.70a2d9ac-ed10-40e6-9f1e-2096972ef3b4" returned: 0 in 0.785s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "cinder-quobyte-70a2d9ac-ed10-40e6-9f1e-2096972ef3b4" released by "_delete_snapshot" :: held 3.351s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "cinder-quobyte-f3df48eb-10c4-4216-afcd-978c48346abf" released by "delete_snapshot" :: held 3.384s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Acquiring lock "cinder-21bce46d-1747-4a65-b7fb-a2a660fc9bc2-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Lock "cinder-21bce46d-1747-4a65-b7fb-a2a660fc9bc2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Acquiring lock "cinder-quobyte-21bce46d-1747-4a65-b7fb-a2a660fc9bc2" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Created reservations ['1ef904c7-4d32-434e-b97b-c735f05516d1', 'b317b120-83d7-4afe-85ee-4b3f5c545731', 'c80af03b-1593-4191-a835-265012c0b5d3', '84e97d6f-29d5-4fb1-b17c-49025b420f7f'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Lock "cinder-quobyte-21bce46d-1747-4a65-b7fb-a2a660fc9bc2" acquired by "delete_volume" :: waited 0.030s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:47 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad" returned: 0 in 0.921s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13db3c3-735f-4b8b-b047-376d0d21d92a]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-21bce46d-1747-4a65-b7fb-a2a660fc9bc2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc8336e-5efd-4dd7-93b5-29599290ce4b]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:47 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7878a17a-a0da-42f4-bdcc-39541c6dce32" returned: 0 in 0.675s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:47 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Delete snapshot completed successfully. Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b45a66a-5266-44f7-9a78-6eda4bf4c576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7878a17a-a0da-42f4-bdcc-39541c6dce32', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e69d28d-5bbc-4674-867a-5f068c414f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-06fe9b49-a41d-4766-a6e5-8b5f26631d1e tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "cinder-70a2d9ac-ed10-40e6-9f1e-2096972ef3b4-delete_snapshot" released by "delete_snapshot" :: held 3.708s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:47 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Volume volume-7878a17a-a0da-42f4-bdcc-39541c6dce32 (7878a17a-a0da-42f4-bdcc-39541c6dce32): created successfully Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e69d28d-5bbc-4674-867a-5f068c414f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:47 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-21bce46d-1747-4a65-b7fb-a2a660fc9bc2 Jun 15 07:25:47 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Flow 'volume_create_manager' (e27d1617-9a13-471a-ac14-2d864daf82f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:47 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-94a4701c-1a11-4463-a339-e7edfef6ade0 tempest-VolumesTransfersV357Test-1907175814 None] Created volume successfully. Jun 15 07:25:47 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 Jun 15 07:25:47 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:48 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-21bce46d-1747-4a65-b7fb-a2a660fc9bc2" returned: 0 in 0.770s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-21bce46d-1747-4a65-b7fb-a2a660fc9bc2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Acquiring lock "cinder-f3df48eb-10c4-4216-afcd-978c48346abf-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:48 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-21bce46d-1747-4a65-b7fb-a2a660fc9bc2 Jun 15 07:25:48 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:48 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3" returned: 0 in 0.808s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "cinder-f3df48eb-10c4-4216-afcd-978c48346abf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:48 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad Jun 15 07:25:48 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Acquiring lock "cinder-quobyte-f3df48eb-10c4-4216-afcd-978c48346abf" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "cinder-quobyte-f3df48eb-10c4-4216-afcd-978c48346abf" acquired by "delete_volume" :: waited 0.034s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[47aa38c3-b926-45ba-a998-54720485d65b]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:48 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf Jun 15 07:25:48 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:48 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-21bce46d-1747-4a65-b7fb-a2a660fc9bc2" returned: 0 in 0.760s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Lock "cinder-quobyte-21bce46d-1747-4a65-b7fb-a2a660fc9bc2" released by "delete_volume" :: held 1.594s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:48 devstack cinder-volume[92129]: WARNING cinder.quota [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:25:48 devstack cinder-volume[92129]: WARNING cinder.quota [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:25:48 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-7cc869be-c13a-4105-8637-1859ccb91680 tempest-VolumesTransfersV357Test-423271203 None] Transfer volume completed successfully. Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Created reservations ['b9c1a4ea-889d-4ec5-91ca-cf4fbea7389e', '464a741c-a133-44ef-8019-75ba98d6722a', '7f638746-3e18-4686-9d71-2dc68a886fe7', '553aac43-58f0-4189-889d-2b3729b84b49'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:48 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:25:48 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:48 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad" returned: 0 in 0.932s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:49 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad Jun 15 07:25:49 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:49 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf" returned: 0 in 0.839s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:49 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf Jun 15 07:25:49 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:49 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.751s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:49 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:49 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Deleted volume successfully. Jun 15 07:25:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-309da6b8-4f60-487d-a9e0-d6997ac161bb tempest-VolumeRetypeWithoutMigrationTest-1753409907 None] Lock "cinder-21bce46d-1747-4a65-b7fb-a2a660fc9bc2-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:49 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3.50b3b40d-cb05-4141-9255-19eaf2a113ad" returned: 0 in 0.847s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] Lock "cinder-quobyte-50b3b40d-cb05-4141-9255-19eaf2a113ad" released by "_delete_snapshot" :: held 3.646s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] Lock "cinder-quobyte-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3" released by "delete_snapshot" :: held 3.676s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:49 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f3df48eb-10c4-4216-afcd-978c48346abf" returned: 0 in 0.899s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "cinder-quobyte-f3df48eb-10c4-4216-afcd-978c48346abf" released by "delete_volume" :: held 1.842s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] Created reservations ['7ace1add-a702-4743-943a-1262500c27e4', '616bfbed-4fa5-4f14-b338-e658dbd350fa', '5466785c-1855-4b07-874e-3d1bd53e93ea', '1bf78851-48c5-4e2b-9cc7-87d6b212bf4d'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:50 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] Delete snapshot completed successfully. Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c5820af9-60bf-48ad-8fc9-06a80f1b4457 tempest-VolumesExtendTest-915029703 None] Lock "cinder-50b3b40d-cb05-4141-9255-19eaf2a113ad-delete_snapshot" released by "delete_snapshot" :: held 3.881s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Created reservations ['0d29301d-de3c-418f-ae6f-98b57dd29dd3', 'ad96306e-d56f-40fa-9e15-96b5733ae65c', '96cc720d-3744-4c67-beaf-c947a6dd38a0', '398488f6-44b9-4e7c-94ea-3def6cb53f88'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] Acquiring lock "cinder-7878a17a-a0da-42f4-bdcc-39541c6dce32-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:50 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:25:50 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] Lock "cinder-7878a17a-a0da-42f4-bdcc-39541c6dce32-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] Acquiring lock "cinder-quobyte-7878a17a-a0da-42f4-bdcc-39541c6dce32" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] Lock "cinder-quobyte-7878a17a-a0da-42f4-bdcc-39541c6dce32" acquired by "delete_volume" :: waited 0.022s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c1515f-8b56-4ccc-9e88-20d3123b4497]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7878a17a-a0da-42f4-bdcc-39541c6dce32 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:50 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7878a17a-a0da-42f4-bdcc-39541c6dce32 Jun 15 07:25:50 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] Acquiring lock "cinder-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] Lock "cinder-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] Acquiring lock "cinder-quobyte-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] Lock "cinder-quobyte-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3" acquired by "delete_volume" :: waited 0.036s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fe8b3f-821f-4b75-8f13-7d54fa4723c3]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:51 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 Jun 15 07:25:51 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:51 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.967s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:51 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:51 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Deleted volume successfully. Jun 15 07:25:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ad382e4c-50d3-4fde-bc61-255e65b96d0f tempest-VolumesSnapshotNegativeTestJSON-806532655 None] Lock "cinder-f3df48eb-10c4-4216-afcd-978c48346abf-delete_volume" released by "delete_volume" :: held 3.150s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:51 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7878a17a-a0da-42f4-bdcc-39541c6dce32" returned: 0 in 1.403s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7878a17a-a0da-42f4-bdcc-39541c6dce32 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:51 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7878a17a-a0da-42f4-bdcc-39541c6dce32 Jun 15 07:25:51 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:52 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3" returned: 0 in 1.146s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:52 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3 Jun 15 07:25:52 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:52 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7878a17a-a0da-42f4-bdcc-39541c6dce32" returned: 0 in 0.905s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] Lock "cinder-quobyte-7878a17a-a0da-42f4-bdcc-39541c6dce32" released by "delete_volume" :: held 2.360s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:52 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] Created reservations ['a56958d8-fed1-4144-b59e-d4f73d2de9dc', 'd9985704-5775-4530-ab80-0d5782223cf5', '69e2ae9f-0855-4d69-8bca-4a04a5fa288d', 'e2d312f9-fd73-44d9-be46-ac0f27e3ddf8'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:52 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3" returned: 0 in 0.788s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] Lock "cinder-quobyte-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3" released by "delete_volume" :: held 2.064s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:52 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:25:52 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:52 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] Created reservations ['82760d9a-a43a-4fe0-b903-bdec8bece579', 'dd9b8fa7-955a-40b6-b24d-9ade71d31fcc', '80024ffe-3a26-444a-a2ab-6f0902f181e3', 'aafa1b85-275b-4933-af28-2fa2afc1914f'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:53 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:25:53 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:53 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.974s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:53 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:53 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] Deleted volume successfully. Jun 15 07:25:53 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f433a2a7-44f2-4b82-a5f4-fc5f8a30c96b tempest-VolumesTransfersV357Test-1584228822 None] Lock "cinder-7878a17a-a0da-42f4-bdcc-39541c6dce32-delete_volume" released by "delete_volume" :: held 3.703s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:54 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.933s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:54 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] Deleted volume successfully. Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b7caa428-3f5c-4ff5-926e-10acbd4855f4 tempest-VolumesExtendTest-915029703 None] Lock "cinder-30a0c1c0-ef06-4515-bc8b-e3d50da8dfd3-delete_volume" released by "delete_volume" :: held 3.391s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Flow 'volume_create_manager' (2a824e68-8c24-4003-855d-e99b68941aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368869be-e548-419b-8235-b0c7b18df55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368869be-e548-419b-8235-b0c7b18df55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1021052125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665738fb-3788-4b19-a4b6-c4f44b2d3b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc9c88e8175d40bd98a13122631b7d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:54Z,use_quota=True,user_id='8822ef258db2411a9a54fac9ded8e201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5abf797d-382d-44cd-92ec-afb7ef89d7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5abf797d-382d-44cd-92ec-afb7ef89d7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ceea03c-1b3b-439e-b7be-28856043e627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ceea03c-1b3b-439e-b7be-28856043e627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '665738fb-3788-4b19-a4b6-c4f44b2d3b9b', 'volume_name': 'volume-665738fb-3788-4b19-a4b6-c4f44b2d3b9b', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc98855-0e3b-4421-9bd4-4cbd929f16fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc98855-0e3b-4421-9bd4-4cbd929f16fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c01ee3ec-4013-4f1c-ab3e-0d1cd1aa30be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:54 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Volume 665738fb-3788-4b19-a4b6-c4f44b2d3b9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-665738fb-3788-4b19-a4b6-c4f44b2d3b9b', 'volume_size': 1} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1021052125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665738fb-3788-4b19-a4b6-c4f44b2d3b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc9c88e8175d40bd98a13122631b7d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:54Z,use_quota=True,user_id='8822ef258db2411a9a54fac9ded8e201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Creating volume 665738fb-3788-4b19-a4b6-c4f44b2d3b9b {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:25:54 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:25:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-665738fb-3788-4b19-a4b6-c4f44b2d3b9b 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:54 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-665738fb-3788-4b19-a4b6-c4f44b2d3b9b 1073741824 Jun 15 07:25:54 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:55 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-665738fb-3788-4b19-a4b6-c4f44b2d3b9b 1073741824" returned: 0 in 1.057s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-665738fb-3788-4b19-a4b6-c4f44b2d3b9b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:55 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-665738fb-3788-4b19-a4b6-c4f44b2d3b9b Jun 15 07:25:55 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:56 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-665738fb-3788-4b19-a4b6-c4f44b2d3b9b" returned: 0 in 1.019s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:56 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] <== create_volume: return (2134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:25:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.136s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c01ee3ec-4013-4f1c-ab3e-0d1cd1aa30be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665738fb-3788-4b19-a4b6-c4f44b2d3b9b', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f3cdea-0eec-4d1c-934f-73aa5a553961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:56 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Volume volume-665738fb-3788-4b19-a4b6-c4f44b2d3b9b (665738fb-3788-4b19-a4b6-c4f44b2d3b9b): created successfully Jun 15 07:25:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f3cdea-0eec-4d1c-934f-73aa5a553961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Flow 'volume_create_manager' (2a824e68-8c24-4003-855d-e99b68941aa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:56 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c1074c14-f454-41dd-a15e-cf7f28b71ba3 tempest-VolumesTransfersV357Test-1907175814 None] Created volume successfully. Jun 15 07:25:57 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:25:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Flow 'volume_create_manager' (4b8d414e-737e-444c-9cf5-518afece4e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e188aa-66cc-4df6-82cd-306182646cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e188aa-66cc-4df6-82cd-306182646cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-727910618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859c562f-5ef5-4da8-a2b8-641e28e04689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebccedbd8a0c4b418ace24d6ba2d0d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:58Z,use_quota=True,user_id='e65fb974ea074c0bb318477004950773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d99dab-9c80-453e-8c26-268c3a6781a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d99dab-9c80-453e-8c26-268c3a6781a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab2cf1b-626c-4de3-a539-0030e7e49dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab2cf1b-626c-4de3-a539-0030e7e49dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '859c562f-5ef5-4da8-a2b8-641e28e04689', 'volume_name': 'volume-859c562f-5ef5-4da8-a2b8-641e28e04689', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65acc273-af01-4bea-91f1-1f36d274b8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65acc273-af01-4bea-91f1-1f36d274b8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5e4074-40e6-46d0-ac30-010bbe69c0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:58 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Volume 859c562f-5ef5-4da8-a2b8-641e28e04689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-859c562f-5ef5-4da8-a2b8-641e28e04689', 'volume_size': 1} Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-727910618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859c562f-5ef5-4da8-a2b8-641e28e04689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebccedbd8a0c4b418ace24d6ba2d0d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:58Z,use_quota=True,user_id='e65fb974ea074c0bb318477004950773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Creating volume 859c562f-5ef5-4da8-a2b8-641e28e04689 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:25:58 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] Acquiring lock "cinder-665738fb-3788-4b19-a4b6-c4f44b2d3b9b-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:58 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689 1073741824 Jun 15 07:25:58 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] Lock "cinder-665738fb-3788-4b19-a4b6-c4f44b2d3b9b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] Acquiring lock "cinder-quobyte-665738fb-3788-4b19-a4b6-c4f44b2d3b9b" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] Lock "cinder-quobyte-665738fb-3788-4b19-a4b6-c4f44b2d3b9b" acquired by "delete_volume" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a568be82-ecbb-4cee-bfeb-f98eead18203]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-665738fb-3788-4b19-a4b6-c4f44b2d3b9b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:58 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-665738fb-3788-4b19-a4b6-c4f44b2d3b9b Jun 15 07:25:58 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689 1073741824" returned: 0 in 1.266s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:59 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:59 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-665738fb-3788-4b19-a4b6-c4f44b2d3b9b" returned: 0 in 1.155s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-665738fb-3788-4b19-a4b6-c4f44b2d3b9b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:59 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689 Jun 15 07:25:59 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:59 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-665738fb-3788-4b19-a4b6-c4f44b2d3b9b Jun 15 07:25:59 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:00 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689" returned: 0 in 0.708s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:26:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5e4074-40e6-46d0-ac30-010bbe69c0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-859c562f-5ef5-4da8-a2b8-641e28e04689', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5f0498-a773-4d2a-8f78-ac816775b142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:00 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Volume volume-859c562f-5ef5-4da8-a2b8-641e28e04689 (859c562f-5ef5-4da8-a2b8-641e28e04689): created successfully Jun 15 07:26:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5f0498-a773-4d2a-8f78-ac816775b142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Flow 'volume_create_manager' (4b8d414e-737e-444c-9cf5-518afece4e5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:00 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-6bbb8c1c-9acc-4b80-9d1e-b67c4dc5a08f tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Created volume successfully. Jun 15 07:26:00 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-665738fb-3788-4b19-a4b6-c4f44b2d3b9b" returned: 0 in 0.810s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] Lock "cinder-quobyte-665738fb-3788-4b19-a4b6-c4f44b2d3b9b" released by "delete_volume" :: held 2.038s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:00 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] Created reservations ['bd22b60d-c571-4733-84c2-64ee07b025c9', '9a95f2f6-d15e-421d-93dd-9fe750848bb3', '13e87a57-cbfe-49c0-9953-254dab9e99d3', '60a4c017-511a-48b2-87ae-21f8b5ff728f'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:26:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:00 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:26:00 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:01 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.734s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:01 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:26:01 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] Deleted volume successfully. Jun 15 07:26:01 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ea4160ba-a588-4caf-95d1-857fe2288fca tempest-VolumesTransfersV357Test-1584228822 None] Lock "cinder-665738fb-3788-4b19-a4b6-c4f44b2d3b9b-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:01 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Creating offline snapshot 84baab40-ebc7-4297-970f-c8ac3a6823ef of volume 859c562f-5ef5-4da8-a2b8-641e28e04689 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:26:01 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[62de0d1b-48a1-4428-affc-5d7a1b5ca1d0]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:01 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689 Jun 15 07:26:01 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:02 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689" returned: 0 in 1.115s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:02 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef 1G Jun 15 07:26:02 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:03 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef 1G" returned: 0 in 0.877s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-859c562f-5ef5-4da8-a2b8-641e28e04689 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:03 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-859c562f-5ef5-4da8-a2b8-641e28e04689 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef Jun 15 07:26:03 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:04 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-859c562f-5ef5-4da8-a2b8-641e28e04689 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef" returned: 0 in 0.769s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:04 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef is being set with open permissions: ugo+rw Jun 15 07:26:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:04 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef Jun 15 07:26:04 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:04 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef" returned: 0 in 0.690s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:04 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.info Jun 15 07:26:04 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:05 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.info" returned: 0 in 0.840s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:05 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.info is being set with open permissions: ugo+rw Jun 15 07:26:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:05 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.info Jun 15 07:26:05 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:06 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.info" returned: 0 in 0.741s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.193s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:06 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-bbffe318-8b86-4436-9c4c-8fef1d76ee77 tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Create snapshot completed successfully Jun 15 07:26:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Acquiring lock "cinder-84baab40-ebc7-4297-970f-c8ac3a6823ef-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "cinder-84baab40-ebc7-4297-970f-c8ac3a6823ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Acquiring lock "cinder-quobyte-859c562f-5ef5-4da8-a2b8-641e28e04689" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "cinder-quobyte-859c562f-5ef5-4da8-a2b8-641e28e04689" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Acquiring lock "cinder-quobyte-84baab40-ebc7-4297-970f-c8ac3a6823ef" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "cinder-quobyte-84baab40-ebc7-4297-970f-c8ac3a6823ef" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Deleting offline snapshot 84baab40-ebc7-4297-970f-c8ac3a6823ef of volume 859c562f-5ef5-4da8-a2b8-641e28e04689 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:26:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] snapshot_file for this snap is: volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:26:08 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5ff358-66b9-42ed-ac9f-824ecd3fcd6b]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:08 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef Jun 15 07:26:08 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:09 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef" returned: 0 in 0.866s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-859c562f-5ef5-4da8-a2b8-641e28e04689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:26:09 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4868a596-d08e-47ed-93e1-798628798f6e]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:09 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689 Jun 15 07:26:09 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:10 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689" returned: 0 in 0.842s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:10 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef Jun 15 07:26:10 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:10 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef" returned: 0 in 0.802s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:10 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef Jun 15 07:26:10 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:11 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689.84baab40-ebc7-4297-970f-c8ac3a6823ef" returned: 0 in 0.754s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:11 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "cinder-quobyte-84baab40-ebc7-4297-970f-c8ac3a6823ef" released by "_delete_snapshot" :: held 3.410s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:11 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "cinder-quobyte-859c562f-5ef5-4da8-a2b8-641e28e04689" released by "delete_snapshot" :: held 3.437s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:11 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Created reservations ['27e20be7-3473-4795-ab0b-6472e8b6fcc6', '9d9e53fe-f7dc-4013-9a56-1172d81c732d', '5ec4f10f-63eb-44a2-a6d2-95fc390b0d77', 'e0481e3e-7527-4d02-ac53-77ec59989bf2'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:26:11 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Delete snapshot completed successfully. Jun 15 07:26:11 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0fcf1148-cef9-449a-9e0e-a5ab921c56ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "cinder-84baab40-ebc7-4297-970f-c8ac3a6823ef-delete_snapshot" released by "delete_snapshot" :: held 3.616s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Acquiring lock "cinder-859c562f-5ef5-4da8-a2b8-641e28e04689-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "cinder-859c562f-5ef5-4da8-a2b8-641e28e04689-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Acquiring lock "cinder-quobyte-859c562f-5ef5-4da8-a2b8-641e28e04689" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "cinder-quobyte-859c562f-5ef5-4da8-a2b8-641e28e04689" acquired by "delete_volume" :: waited 0.032s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:12 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4901568-e4e2-4b2c-84e3-022d1873399a]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:12 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689 Jun 15 07:26:12 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:13 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689" returned: 0 in 0.858s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:13 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689 Jun 15 07:26:13 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:26:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:14 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:26:14 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:14 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-859c562f-5ef5-4da8-a2b8-641e28e04689" returned: 0 in 0.806s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:14 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "cinder-quobyte-859c562f-5ef5-4da8-a2b8-641e28e04689" released by "delete_volume" :: held 1.750s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:14 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Created reservations ['327df987-3925-4480-a268-4fc715843723', '254384c2-0ced-41f1-ae42-4a7b5c2e4e1d', 'f5d172a4-ec20-4642-89dc-83c5ff0efe7b', '6af8bf4a-0ce7-458a-af76-53d49edd51d6'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:26:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:14 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:14 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:14 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:26:14 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:15 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.080s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:15 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:26:15 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:26:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 28 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:26:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:26:15 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.221s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:15 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:26:15 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Deleted volume successfully. Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e92ea715-5d50-4f13-a2e6-296ef2e2ea6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1821517558 None] Lock "cinder-859c562f-5ef5-4da8-a2b8-641e28e04689-delete_volume" released by "delete_volume" :: held 3.354s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Flow 'volume_create_manager' (2f1934c4-f92e-49b7-a924-f2e2163ba179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d2ae99-84b5-4ab5-8ec9-87832d34b241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d2ae99-84b5-4ab5-8ec9-87832d34b241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1959563208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10900a6e-862b-4e6f-bf85-61b77d4451b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0eda5af40be4e24afa741c71ba88bc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:16Z,use_quota=True,user_id='336fc14ecd224de3b5d6eb7a726faee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (770b5e27-bdbe-43ca-9844-b121de7a72ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (770b5e27-bdbe-43ca-9844-b121de7a72ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5313f60d-739e-4fcf-8aa7-2a97535d41f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5313f60d-739e-4fcf-8aa7-2a97535d41f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10900a6e-862b-4e6f-bf85-61b77d4451b0', 'volume_name': 'volume-10900a6e-862b-4e6f-bf85-61b77d4451b0', 'volume_size': 2}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9bf110-70bb-4fc2-b0e3-afc56fe6cee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9bf110-70bb-4fc2-b0e3-afc56fe6cee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45339b26-5279-4e26-8f17-1d575813dcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:16 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Volume 10900a6e-862b-4e6f-bf85-61b77d4451b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10900a6e-862b-4e6f-bf85-61b77d4451b0', 'volume_size': 2} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1959563208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10900a6e-862b-4e6f-bf85-61b77d4451b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0eda5af40be4e24afa741c71ba88bc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:16Z,use_quota=True,user_id='336fc14ecd224de3b5d6eb7a726faee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Creating volume 10900a6e-862b-4e6f-bf85-61b77d4451b0 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:26:16 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:26:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10900a6e-862b-4e6f-bf85-61b77d4451b0 2147483648 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:16 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10900a6e-862b-4e6f-bf85-61b77d4451b0 2147483648 Jun 15 07:26:16 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:17 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10900a6e-862b-4e6f-bf85-61b77d4451b0 2147483648" returned: 0 in 1.157s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10900a6e-862b-4e6f-bf85-61b77d4451b0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:17 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10900a6e-862b-4e6f-bf85-61b77d4451b0 Jun 15 07:26:17 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:18 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10900a6e-862b-4e6f-bf85-61b77d4451b0" returned: 0 in 0.927s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:26:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.151s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45339b26-5279-4e26-8f17-1d575813dcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10900a6e-862b-4e6f-bf85-61b77d4451b0', 'volume_size': 2}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82fd6698-26ce-4f9a-be23-fadd1644ba7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:18 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Volume volume-10900a6e-862b-4e6f-bf85-61b77d4451b0 (10900a6e-862b-4e6f-bf85-61b77d4451b0): created successfully Jun 15 07:26:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82fd6698-26ce-4f9a-be23-fadd1644ba7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Flow 'volume_create_manager' (2f1934c4-f92e-49b7-a924-f2e2163ba179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:18 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-b214f0f2-004d-44ff-8c0a-bfe397cd1b6f tempest-VolumesCloneNegativeTest-1002985566 None] Created volume successfully. Jun 15 07:26:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] Acquiring lock "cinder-10900a6e-862b-4e6f-bf85-61b77d4451b0-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] Lock "cinder-10900a6e-862b-4e6f-bf85-61b77d4451b0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] Acquiring lock "cinder-quobyte-10900a6e-862b-4e6f-bf85-61b77d4451b0" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] Lock "cinder-quobyte-10900a6e-862b-4e6f-bf85-61b77d4451b0" acquired by "delete_volume" :: waited 0.031s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:19 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e33f08d-5cf1-463e-b400-30a6cf75b9f6]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10900a6e-862b-4e6f-bf85-61b77d4451b0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:20 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10900a6e-862b-4e6f-bf85-61b77d4451b0 Jun 15 07:26:20 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:20 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10900a6e-862b-4e6f-bf85-61b77d4451b0" returned: 0 in 0.932s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10900a6e-862b-4e6f-bf85-61b77d4451b0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:20 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10900a6e-862b-4e6f-bf85-61b77d4451b0 Jun 15 07:26:20 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:21 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-10900a6e-862b-4e6f-bf85-61b77d4451b0" returned: 0 in 0.687s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] Lock "cinder-quobyte-10900a6e-862b-4e6f-bf85-61b77d4451b0" released by "delete_volume" :: held 1.678s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:21 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] Created reservations ['c7e5db5b-f5ec-42ad-80da-30c1cecbcfcc', '3f5bb35c-6467-47e5-964e-f3734df8cf0e', '5832b9d7-7b14-4dbb-8290-94b50398043f', '571cd099-3246-413e-9352-06f09fb643d4'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:26:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:21 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:26:21 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:22 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.953s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:22 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:26:22 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] Deleted volume successfully. Jun 15 07:26:22 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=108,cinder:INSERT=39,cinder:UPDATE=130,cinder:DELETE=9 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:26:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4be2fb54-5a62-4c78-be8a-3cc6a8ccda6d tempest-VolumesCloneNegativeTest-1002985566 None] Lock "cinder-10900a6e-862b-4e6f-bf85-61b77d4451b0-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:INSERT=27,cinder:UPDATE=142,cinder:SELECT=103,cinder:DELETE=12 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Flow 'volume_create_manager' (9ecd86fa-3cd8-457a-bac5-9e3896ab3f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25928c67-369e-420e-b1fa-ab71c420e2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25928c67-369e-420e-b1fa-ab71c420e2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1602651080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea6c2a2-734c-4c8d-af1e-6588dc800601,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fb335354c01e4c0f81c62a8315f06c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:27Z,use_quota=True,user_id='4b0d93b3699640a4bc6fd12c350687fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af7b317-5aff-4e6b-a59d-83d5215937c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af7b317-5aff-4e6b-a59d-83d5215937c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7a5982-674e-46f9-91ae-205abb675ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7a5982-674e-46f9-91ae-205abb675ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fea6c2a2-734c-4c8d-af1e-6588dc800601', 'volume_name': 'volume-fea6c2a2-734c-4c8d-af1e-6588dc800601', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff9bf88-760a-404a-b840-e48b6630fdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff9bf88-760a-404a-b840-e48b6630fdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ee86e7-1378-4ee7-88a8-bb53a54c134b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:27 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Volume fea6c2a2-734c-4c8d-af1e-6588dc800601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fea6c2a2-734c-4c8d-af1e-6588dc800601', 'volume_size': 1} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1602651080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea6c2a2-734c-4c8d-af1e-6588dc800601,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fb335354c01e4c0f81c62a8315f06c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:27Z,use_quota=True,user_id='4b0d93b3699640a4bc6fd12c350687fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Creating volume fea6c2a2-734c-4c8d-af1e-6588dc800601 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:26:27 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:26:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fea6c2a2-734c-4c8d-af1e-6588dc800601 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:27 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fea6c2a2-734c-4c8d-af1e-6588dc800601 1073741824 Jun 15 07:26:27 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:28 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:26:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Flow 'volume_create_manager' (0f5ee920-82ef-462e-9007-bdb3fd5fd4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ff2e7e-9a5c-4442-b77f-b31a539e023c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ff2e7e-9a5c-4442-b77f-b31a539e023c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2138416130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a4ee11-a0db-4058-b80c-3bc793232817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b37d1744399451fb18cf6bc61c8453a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:28Z,use_quota=True,user_id='b1dcb2fbbfb0404f8f71938d03f40e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb583326-dfb7-4ce4-b922-baa08d0f9d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb583326-dfb7-4ce4-b922-baa08d0f9d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3770ac-1c00-4627-b981-9cd8044ca728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:28 devstack cinder-volume[92129]: DEBUG cinder.image.glance [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Creating Keystone auth plugin from conf {{(pid=92129) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:26:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3770ac-1c00-4627-b981-9cd8044ca728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd3a4ee11-a0db-4058-b80c-3bc793232817', 'volume_name': 'volume-d3a4ee11-a0db-4058-b80c-3bc793232817', 'volume_size': 1, 'image_id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0d4c76bb4c8424fbbbc7d856674ea3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'created_at': datetime.datetime(2026, 6, 15, 5, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af781faa-2398-41b5-9cb2-cfe0761734f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790a185a-95ab-42b0-a490-74dfbf43ca35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:28 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790a185a-95ab-42b0-a490-74dfbf43ca35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1742c5db-6c5d-43ba-b2f1-06938438b22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:28 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Volume d3a4ee11-a0db-4058-b80c-3bc793232817: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d3a4ee11-a0db-4058-b80c-3bc793232817', 'volume_size': 1, 'image_id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0d4c76bb4c8424fbbbc7d856674ea3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'created_at': datetime.datetime(2026, 6, 15, 5, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af781faa-2398-41b5-9cb2-cfe0761734f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 15 07:26:28 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Trying to clone d3a4ee11-a0db-4058-b80c-3bc793232817 from image af781faa-2398-41b5-9cb2-cfe0761734f9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}]). {{(pid=92129) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:26:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fea6c2a2-734c-4c8d-af1e-6588dc800601 1073741824" returned: 0 in 1.366s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fea6c2a2-734c-4c8d-af1e-6588dc800601 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:29 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fea6c2a2-734c-4c8d-af1e-6588dc800601 Jun 15 07:26:29 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:29 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_x7mavq6_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:26:29 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Image download 20.69 MB at 20.69 MB/s Jun 15 07:26:29 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6891d4aa-a0de-43ce-a2fd-6788f62a5dc7]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_x7mavq6_devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:29 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_x7mavq6_devstack@QuobyteHD Jun 15 07:26:29 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:30 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fea6c2a2-734c-4c8d-af1e-6588dc800601" returned: 0 in 0.956s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] <== create_volume: return (2492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:26:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.497s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ee86e7-1378-4ee7-88a8-bb53a54c134b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fea6c2a2-734c-4c8d-af1e-6588dc800601', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (381953f8-9ea9-46ef-b033-2365422ed415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:30 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Volume volume-fea6c2a2-734c-4c8d-af1e-6588dc800601 (fea6c2a2-734c-4c8d-af1e-6588dc800601): created successfully Jun 15 07:26:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (381953f8-9ea9-46ef-b033-2365422ed415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Flow 'volume_create_manager' (9ecd86fa-3cd8-457a-bac5-9e3896ab3f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:30 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-e7d9daa6-bff8-4225-a4e0-fc1bba017439 tempest-VolumesGetTest-823806120 None] Created volume successfully. Jun 15 07:26:30 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_x7mavq6_devstack@QuobyteHD" returned: 0 in 0.781s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:30 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Temporary image af781faa-2398-41b5-9cb2-cfe0761734f9 is fetched for user b1dcb2fbbfb0404f8f71938d03f40e62. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:26:30 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84e965f-f5d2-468c-b1ed-b0140d17611f]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_x7mavq6_devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:30 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_x7mavq6_devstack@QuobyteHD Jun 15 07:26:30 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:31 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_x7mavq6_devstack@QuobyteHD" returned: 0 in 0.819s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2138416130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a4ee11-a0db-4058-b80c-3bc793232817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b37d1744399451fb18cf6bc61c8453a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:28Z,use_quota=True,user_id='b1dcb2fbbfb0404f8f71938d03f40e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Creating volume d3a4ee11-a0db-4058-b80c-3bc793232817 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:26:31 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:31 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 1073741824 Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:26:31 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Flow 'volume_create_manager' (71c3ddbe-ab31-422b-babc-e304649fb5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d457f3-2a4f-4298-83d3-70611ae6f302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d457f3-2a4f-4298-83d3-70611ae6f302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2062564327',display_name='tempest-VolumesGetTest-Volume-1167035065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032c0eff-fed7-47f1-a617-06d18c79957d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb335354c01e4c0f81c62a8315f06c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:31Z,use_quota=True,user_id='4b0d93b3699640a4bc6fd12c350687fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6039288c-7bb7-4714-8d1e-54db9db8f158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6039288c-7bb7-4714-8d1e-54db9db8f158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dcf29b8-e8ab-47e8-a6d8-d2bb199195ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dcf29b8-e8ab-47e8-a6d8-d2bb199195ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '032c0eff-fed7-47f1-a617-06d18c79957d', 'volume_name': 'volume-032c0eff-fed7-47f1-a617-06d18c79957d', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b9943b-ad65-46eb-9f2e-26f0a376d449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b9943b-ad65-46eb-9f2e-26f0a376d449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10acdd0d-b715-49cf-9779-f6e10757fdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:31 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Volume 032c0eff-fed7-47f1-a617-06d18c79957d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-032c0eff-fed7-47f1-a617-06d18c79957d', 'volume_size': 1} Jun 15 07:26:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:32 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 1073741824" returned: 0 in 1.053s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:32 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 Jun 15 07:26:32 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:33 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817" returned: 0 in 0.751s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:26:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.735s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2062564327',display_name='tempest-VolumesGetTest-Volume-1167035065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032c0eff-fed7-47f1-a617-06d18c79957d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb335354c01e4c0f81c62a8315f06c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:31Z,use_quota=True,user_id='4b0d93b3699640a4bc6fd12c350687fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:26:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Creating volume 032c0eff-fed7-47f1-a617-06d18c79957d {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:26:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:26:33 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:26:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-032c0eff-fed7-47f1-a617-06d18c79957d 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:33 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Attempting download of af781faa-2398-41b5-9cb2-cfe0761734f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}])) to volume d3a4ee11-a0db-4058-b80c-3bc793232817. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:26:33 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-032c0eff-fed7-47f1-a617-06d18c79957d 1073741824 Jun 15 07:26:33 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:33 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[09005ced-054b-458b-8bb0-a076fb164872]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_bz4pnmie {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:33 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_bz4pnmie Jun 15 07:26:33 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:34 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_bz4pnmie" returned: 0 in 1.075s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_bz4pnmie {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:34 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-032c0eff-fed7-47f1-a617-06d18c79957d 1073741824" returned: 0 in 1.231s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-032c0eff-fed7-47f1-a617-06d18c79957d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:34 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-032c0eff-fed7-47f1-a617-06d18c79957d Jun 15 07:26:34 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:34 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_bz4pnmie Jun 15 07:26:34 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:35 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-032c0eff-fed7-47f1-a617-06d18c79957d" returned: 0 in 0.836s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:35 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] <== create_volume: return (2166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:26:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10acdd0d-b715-49cf-9779-f6e10757fdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-032c0eff-fed7-47f1-a617-06d18c79957d', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b648c87-8adc-46a6-8b62-320b74a2fb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:35 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Volume volume-032c0eff-fed7-47f1-a617-06d18c79957d (032c0eff-fed7-47f1-a617-06d18c79957d): created successfully Jun 15 07:26:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b648c87-8adc-46a6-8b62-320b74a2fb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:35 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Flow 'volume_create_manager' (71c3ddbe-ab31-422b-babc-e304649fb5e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:35 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-ebbe2c80-4ba5-4f89-8d5a-ed02de5676e6 tempest-VolumesGetTest-823806120 None] Created volume successfully. Jun 15 07:26:35 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_bz4pnmie" returned: 1 in 1.036s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_bz4pnmie' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:26:35 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[03882bcd-7d6e-4880-8875-aa0cb6a907b4]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_x7mavq6_devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:35 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_x7mavq6_devstack@QuobyteHD Jun 15 07:26:35 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] Acquiring lock "cinder-032c0eff-fed7-47f1-a617-06d18c79957d-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] Lock "cinder-032c0eff-fed7-47f1-a617-06d18c79957d-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] Acquiring lock "cinder-quobyte-032c0eff-fed7-47f1-a617-06d18c79957d" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-032c0eff-fed7-47f1-a617-06d18c79957d" acquired by "delete_volume" :: waited 0.036s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:36 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1adabb0-9bc4-4083-829b-cccb746cab98]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-032c0eff-fed7-47f1-a617-06d18c79957d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:36 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-032c0eff-fed7-47f1-a617-06d18c79957d Jun 15 07:26:36 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:36 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_x7mavq6_devstack@QuobyteHD" returned: 0 in 0.871s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:36 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] af781faa-2398-41b5-9cb2-cfe0761734f9 was qcow2, converting to raw {{(pid=92129) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:26:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_x7mavq6_devstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:36 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_x7mavq6_devstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 Jun 15 07:26:36 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:36 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:26:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Flow 'volume_create_manager' (fad84667-78e7-46dc-9331-02ab6f438469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97931fb2-4f4d-4939-b830-31d3dcc27158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97931fb2-4f4d-4939-b830-31d3dcc27158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-417353865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d12f77-e0d2-4639-92ca-87a15b00f73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7958cd2df41a46a79f574868bbafdfd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:37Z,use_quota=True,user_id='07f9acfe43274e5c818d99af0b566194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dac2435-1c2f-422f-827f-5dc3dc1e0ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dac2435-1c2f-422f-827f-5dc3dc1e0ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b32896d6-4976-4c59-9988-4ffe3a3eaf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:37 devstack cinder-volume[92129]: DEBUG cinder.image.glance [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Creating Keystone auth plugin from conf {{(pid=92129) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:26:37 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-032c0eff-fed7-47f1-a617-06d18c79957d" returned: 0 in 0.884s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-032c0eff-fed7-47f1-a617-06d18c79957d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:37 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-032c0eff-fed7-47f1-a617-06d18c79957d Jun 15 07:26:37 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b32896d6-4976-4c59-9988-4ffe3a3eaf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '31d12f77-e0d2-4639-92ca-87a15b00f73a', 'volume_name': 'volume-31d12f77-e0d2-4639-92ca-87a15b00f73a', 'volume_size': 1, 'image_id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0d4c76bb4c8424fbbbc7d856674ea3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'created_at': datetime.datetime(2026, 6, 15, 5, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af781faa-2398-41b5-9cb2-cfe0761734f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e21abb-cb4b-47ed-aad3-811d7ed63ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e21abb-cb4b-47ed-aad3-811d7ed63ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6866f22e-6c8f-4c7c-962f-23ec64897bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:37 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Volume 31d12f77-e0d2-4639-92ca-87a15b00f73a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-31d12f77-e0d2-4639-92ca-87a15b00f73a', 'volume_size': 1, 'image_id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0d4c76bb4c8424fbbbc7d856674ea3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'created_at': datetime.datetime(2026, 6, 15, 5, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af781faa-2398-41b5-9cb2-cfe0761734f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 15 07:26:37 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Trying to clone 31d12f77-e0d2-4639-92ca-87a15b00f73a from image af781faa-2398-41b5-9cb2-cfe0761734f9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}]). {{(pid=92129) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:26:37 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-032c0eff-fed7-47f1-a617-06d18c79957d" returned: 0 in 0.835s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-032c0eff-fed7-47f1-a617-06d18c79957d" released by "delete_volume" :: held 1.783s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:38 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] Created reservations ['7fe72c9d-7dfe-4775-b66d-77aa6c166c6e', 'c4993577-5c50-4629-b919-65dde2c9098e', 'ce2bce90-46ef-40de-9e7c-d891baaee238', 'd0a710f0-1533-485d-892e-18b6d87a3b81'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:26:38 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_s576j2e7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:26:38 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Image download 20.69 MB at 20.69 MB/s Jun 15 07:26:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:38 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ff0a81-baae-466b-a093-8b4c88e255d1]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_s576j2e7devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:38 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:26:38 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] Acquiring lock "cinder-fea6c2a2-734c-4c8d-af1e-6588dc800601-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] Lock "cinder-fea6c2a2-734c-4c8d-af1e-6588dc800601-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:38 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_s576j2e7devstack@QuobyteHD Jun 15 07:26:38 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] Acquiring lock "cinder-quobyte-fea6c2a2-734c-4c8d-af1e-6588dc800601" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-fea6c2a2-734c-4c8d-af1e-6588dc800601" acquired by "delete_volume" :: waited 0.041s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:38 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d84699-b7f0-41f7-8431-27050f5c89c5]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fea6c2a2-734c-4c8d-af1e-6588dc800601 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:38 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fea6c2a2-734c-4c8d-af1e-6588dc800601 Jun 15 07:26:38 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:39 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:39 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_s576j2e7devstack@QuobyteHD" returned: 0 in 0.870s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:39 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Temporary image af781faa-2398-41b5-9cb2-cfe0761734f9 is fetched for user 07f9acfe43274e5c818d99af0b566194. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:26:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_x7mavq6_devstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817" returned: 0 in 2.738s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:39 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_x7mavq6_devstack@QuobyteHD, size 112.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:26:39 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Converted 112.00 MB image at 40.89 MB/s Jun 15 07:26:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:39 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 1G Jun 15 07:26:39 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:39 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.988s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:39 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:26:39 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] Deleted volume successfully. Jun 15 07:26:39 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8d1d82-9e74-4056-b3af-5b2397632caf]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_s576j2e7devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-130e56bd-aebe-4c71-aa2c-a00c744f014a tempest-VolumesGetTest-823806120 None] Lock "cinder-032c0eff-fed7-47f1-a617-06d18c79957d-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:39 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_s576j2e7devstack@QuobyteHD Jun 15 07:26:39 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:39 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fea6c2a2-734c-4c8d-af1e-6588dc800601" returned: 0 in 0.893s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fea6c2a2-734c-4c8d-af1e-6588dc800601 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:39 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fea6c2a2-734c-4c8d-af1e-6588dc800601 Jun 15 07:26:39 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:39 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 1G" returned: 0 in 0.724s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:39 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5032d001-adea-4e99-8489-3a2354f087e2]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:40 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_s576j2e7devstack@QuobyteHD" returned: 0 in 0.748s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-417353865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d12f77-e0d2-4639-92ca-87a15b00f73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7958cd2df41a46a79f574868bbafdfd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:37Z,use_quota=True,user_id='07f9acfe43274e5c818d99af0b566194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Creating volume 31d12f77-e0d2-4639-92ca-87a15b00f73a {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:26:40 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:40 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a 1073741824 Jun 15 07:26:40 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:40 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 Jun 15 07:26:40 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:40 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fea6c2a2-734c-4c8d-af1e-6588dc800601" returned: 0 in 0.718s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-fea6c2a2-734c-4c8d-af1e-6588dc800601" released by "delete_volume" :: held 1.665s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] Created reservations ['687a03cb-b266-4efe-9fec-c8e448ea3671', '4ea6e5d8-51ce-40eb-bb3a-bb17df8cf1b7', '2c7ad493-02c2-4f11-ae1a-bf6527cdf11a', '63ed9364-6884-43a1-af15-bd1427e5ada2'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:40 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:26:40 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:41 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817" returned: 0 in 1.169s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:41 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a 1073741824" returned: 0 in 1.282s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:41 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 Jun 15 07:26:41 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:41 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a Jun 15 07:26:41 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:41 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:26:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Flow 'volume_create_manager' (a8ce4f5d-893a-49ce-88f4-b0a3b4a72964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb046ece-23ab-4dfa-8e24-aef53122ef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb046ece-23ab-4dfa-8e24-aef53122ef15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-677579823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906118be-3be3-4da6-b85e-fc11508c4948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb335354c01e4c0f81c62a8315f06c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:42Z,use_quota=True,user_id='4b0d93b3699640a4bc6fd12c350687fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:42 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08acbbd-ce88-4e38-ad47-52dceccb44ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08acbbd-ce88-4e38-ad47-52dceccb44ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cbc52f7-8e92-4324-9931-cfe2809d5245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cbc52f7-8e92-4324-9931-cfe2809d5245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '906118be-3be3-4da6-b85e-fc11508c4948', 'volume_name': 'volume-906118be-3be3-4da6-b85e-fc11508c4948', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7d3fab-f5f8-45a5-a47c-7bd176d418ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7d3fab-f5f8-45a5-a47c-7bd176d418ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b50938-c791-4d06-88c8-0cee431aa606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:42 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Volume 906118be-3be3-4da6-b85e-fc11508c4948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-906118be-3be3-4da6-b85e-fc11508c4948', 'volume_size': 1} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.805s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:26:42 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] Deleted volume successfully. Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ae2a8617-92ed-4a46-971a-10e7f8c77dc6 tempest-VolumesGetTest-823806120 None] Lock "cinder-fea6c2a2-734c-4c8d-af1e-6588dc800601-delete_volume" released by "delete_volume" :: held 3.761s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:42 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817" returned: 1 in 1.388s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Downloaded image af781faa-2398-41b5-9cb2-cfe0761734f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}])) to volume d3a4ee11-a0db-4058-b80c-3bc793232817 successfully. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Temporary image af781faa-2398-41b5-9cb2-cfe0761734f9 for user b1dcb2fbbfb0404f8f71938d03f40e62 is deleted. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Marking volume d3a4ee11-a0db-4058-b80c-3bc793232817 as bootable. {{(pid=92129) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:26:42 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a" returned: 0 in 1.089s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] <== create_volume: return (2502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.505s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.376s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-677579823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906118be-3be3-4da6-b85e-fc11508c4948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb335354c01e4c0f81c62a8315f06c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:42Z,use_quota=True,user_id='4b0d93b3699640a4bc6fd12c350687fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Creating volume 906118be-3be3-4da6-b85e-fc11508c4948 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:26:42 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Copying metadata from image af781faa-2398-41b5-9cb2-cfe0761734f9 to d3a4ee11-a0db-4058-b80c-3bc793232817. {{(pid=92129) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Creating volume glance metadata for volume d3a4ee11-a0db-4058-b80c-3bc793232817 backed by image af781faa-2398-41b5-9cb2-cfe0761734f9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92129) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:26:42 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 1073741824 Jun 15 07:26:42 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Attempting download of af781faa-2398-41b5-9cb2-cfe0761734f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}])) to volume 31d12f77-e0d2-4639-92ca-87a15b00f73a. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fcf225-eb8d-42c9-9bfc-bf0a9e9c23fb]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_x56532n9 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1742c5db-6c5d-43ba-b2f1-06938438b22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a4ee11-a0db-4058-b80c-3bc793232817', 'volume_size': 1, 'image_id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0d4c76bb4c8424fbbbc7d856674ea3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'created_at': datetime.datetime(2026, 6, 15, 5, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af781faa-2398-41b5-9cb2-cfe0761734f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8480113-2fc5-4bc4-9f96-704a41c0d4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:42 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Volume volume-d3a4ee11-a0db-4058-b80c-3bc793232817 (d3a4ee11-a0db-4058-b80c-3bc793232817): created successfully Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8480113-2fc5-4bc4-9f96-704a41c0d4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Flow 'volume_create_manager' (0f5ee920-82ef-462e-9007-bdb3fd5fd4c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:42 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-998f3964-9d9c-4af1-b1b9-9e3348a383f2 tempest-VolumesImageMetadata-1708130352 None] Created volume successfully. Jun 15 07:26:42 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_x56532n9 Jun 15 07:26:42 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:43 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 1073741824" returned: 0 in 1.114s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:43 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_x56532n9" returned: 0 in 1.039s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_x56532n9 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:43 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 Jun 15 07:26:43 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:43 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_x56532n9 Jun 15 07:26:43 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:44 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948" returned: 0 in 0.805s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:44 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] <== create_volume: return (1965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:26:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b50938-c791-4d06-88c8-0cee431aa606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-906118be-3be3-4da6-b85e-fc11508c4948', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd586a0-f5a6-4eec-a894-52dd35d62c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:44 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Volume volume-906118be-3be3-4da6-b85e-fc11508c4948 (906118be-3be3-4da6-b85e-fc11508c4948): created successfully Jun 15 07:26:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd586a0-f5a6-4eec-a894-52dd35d62c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Flow 'volume_create_manager' (a8ce4f5d-893a-49ce-88f4-b0a3b4a72964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:44 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-5bf7fca3-9c2d-48dc-bb21-506c2d8abf98 tempest-VolumesGetTest-823806120 None] Created volume successfully. Jun 15 07:26:44 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_x56532n9" returned: 1 in 1.014s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_x56532n9' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:26:44 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6d27aa-4e9f-404b-aeae-3b44f6cf3035]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_s576j2e7devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:44 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_s576j2e7devstack@QuobyteHD Jun 15 07:26:44 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Acquiring lock "cinder-d3a4ee11-a0db-4058-b80c-3bc793232817-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Lock "cinder-d3a4ee11-a0db-4058-b80c-3bc793232817-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Acquiring lock "cinder-quobyte-d3a4ee11-a0db-4058-b80c-3bc793232817" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Lock "cinder-quobyte-d3a4ee11-a0db-4058-b80c-3bc793232817" acquired by "delete_volume" :: waited 0.035s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:45 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ac0a65-543f-43e9-8ecb-58f6dc82e5ce]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:45 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 Jun 15 07:26:45 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:45 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_s576j2e7devstack@QuobyteHD" returned: 0 in 0.997s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:45 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] af781faa-2398-41b5-9cb2-cfe0761734f9 was qcow2, converting to raw {{(pid=92129) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:26:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_s576j2e7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:45 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_s576j2e7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a Jun 15 07:26:45 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Flow 'volume_create_manager' (9d6eb325-46c7-4578-a71a-2903ef44fbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3479685-6181-4364-bc56-ace3fff516e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3479685-6181-4364-bc56-ace3fff516e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-441362236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d05e81ec-6c81-4f0f-81ce-a4eb92577ee4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fb335354c01e4c0f81c62a8315f06c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=906118be-3be3-4da6-b85e-fc11508c4948,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:46Z,use_quota=True,user_id='4b0d93b3699640a4bc6fd12c350687fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc610f79-41e9-4460-ba56-b4a106e1f50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc610f79-41e9-4460-ba56-b4a106e1f50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d001a31-bdc2-475f-857f-a73f9153fca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d001a31-bdc2-475f-857f-a73f9153fca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd05e81ec-6c81-4f0f-81ce-a4eb92577ee4', 'volume_name': 'volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4', 'volume_size': 1, 'source_volid': '906118be-3be3-4da6-b85e-fc11508c4948', 'source_volstatus': 'available'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afccb40f-f3c7-4ea7-aedd-04c56dce54ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afccb40f-f3c7-4ea7-aedd-04c56dce54ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78b8a2d-940a-41a8-970c-75a7349081c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:46 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Volume d05e81ec-6c81-4f0f-81ce-a4eb92577ee4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4', 'volume_size': 1, 'source_volid': '906118be-3be3-4da6-b85e-fc11508c4948', 'source_volstatus': 'available'} Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:46 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Cloning volume 906118be-3be3-4da6-b85e-fc11508c4948 to volume d05e81ec-6c81-4f0f-81ce-a4eb92577ee4 Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Creating offline snapshot f5140010-2f99-4504-b2ae-a1aeb4194efc of volume 906118be-3be3-4da6-b85e-fc11508c4948 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7f3a6f-cd0f-4d2b-b969-6740ce878606]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:46 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817" returned: 0 in 1.227s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:46 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 Jun 15 07:26:46 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:46 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 Jun 15 07:26:46 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:47 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948" returned: 0 in 1.233s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:47 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc 1G Jun 15 07:26:47 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:47 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817" returned: 1 in 1.184s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:26:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:47 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817 Jun 15 07:26:47 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:48 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_s576j2e7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a" returned: 0 in 2.660s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:48 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_s576j2e7devstack@QuobyteHD, size 112.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:26:48 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Converted 112.00 MB image at 42.08 MB/s Jun 15 07:26:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:48 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a 1G Jun 15 07:26:48 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:48 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d3a4ee11-a0db-4058-b80c-3bc793232817" returned: 0 in 0.897s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Lock "cinder-quobyte-d3a4ee11-a0db-4058-b80c-3bc793232817" released by "delete_volume" :: held 3.429s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:48 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc 1G" returned: 0 in 1.100s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906118be-3be3-4da6-b85e-fc11508c4948 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:48 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906118be-3be3-4da6-b85e-fc11508c4948 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc Jun 15 07:26:48 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:48 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Created reservations ['b1ed622f-75ea-431f-8b9a-9be87e8e1f55', 'd4bb04b3-eabe-46e4-bcf3-369d0b1eae95', '97849a21-56cd-4f49-aa59-3a9349284a88', '63488ed2-977f-4b15-9318-8cc7baf575db'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:26:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:48 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:26:48 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:49 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a 1G" returned: 0 in 1.148s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:49 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906118be-3be3-4da6-b85e-fc11508c4948 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc" returned: 0 in 0.871s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:49 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc is being set with open permissions: ugo+rw Jun 15 07:26:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:49 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac796348-12e9-49bb-b09f-31c7bb0cec9b]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:49 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc Jun 15 07:26:49 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:49 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.800s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:49 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:26:49 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Deleted volume successfully. Jun 15 07:26:49 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a Jun 15 07:26:49 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-33324f22-4158-46e7-b116-47140f013448 tempest-VolumesImageMetadata-1708130352 None] Lock "cinder-d3a4ee11-a0db-4058-b80c-3bc793232817-delete_volume" released by "delete_volume" :: held 4.682s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:50 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc" returned: 0 in 1.048s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:50 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a" returned: 0 in 1.045s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:50 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.info Jun 15 07:26:50 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:50 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a Jun 15 07:26:50 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:51 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.info" returned: 0 in 0.795s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:51 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.info is being set with open permissions: ugo+rw Jun 15 07:26:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:51 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.info Jun 15 07:26:51 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:51 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a" returned: 1 in 1.217s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:26:51 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Downloaded image af781faa-2398-41b5-9cb2-cfe0761734f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}])) to volume 31d12f77-e0d2-4639-92ca-87a15b00f73a successfully. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:26:51 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Temporary image af781faa-2398-41b5-9cb2-cfe0761734f9 for user 07f9acfe43274e5c818d99af0b566194 is deleted. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:26:51 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Marking volume 31d12f77-e0d2-4639-92ca-87a15b00f73a as bootable. {{(pid=92129) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:26:51 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Copying metadata from image af781faa-2398-41b5-9cb2-cfe0761734f9 to 31d12f77-e0d2-4639-92ca-87a15b00f73a. {{(pid=92129) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:26:51 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Creating volume glance metadata for volume 31d12f77-e0d2-4639-92ca-87a15b00f73a backed by image af781faa-2398-41b5-9cb2-cfe0761734f9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92129) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:26:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6866f22e-6c8f-4c7c-962f-23ec64897bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31d12f77-e0d2-4639-92ca-87a15b00f73a', 'volume_size': 1, 'image_id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0d4c76bb4c8424fbbbc7d856674ea3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'created_at': datetime.datetime(2026, 6, 15, 5, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af781faa-2398-41b5-9cb2-cfe0761734f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66037a58-d135-4547-94df-72903f1545d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:52 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Volume volume-31d12f77-e0d2-4639-92ca-87a15b00f73a (31d12f77-e0d2-4639-92ca-87a15b00f73a): created successfully Jun 15 07:26:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66037a58-d135-4547-94df-72903f1545d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Flow 'volume_create_manager' (fad84667-78e7-46dc-9331-02ab6f438469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:52 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-7a921e04-965d-484c-a963-57d8219742e7 tempest-TestShelveInstance-242574027 None] Created volume successfully. Jun 15 07:26:52 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.info" returned: 0 in 1.043s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Acquiring lock "cinder-quobyte-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4" by "_copy_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] snapshot: f5140010-2f99-4504-b2ae-a1aeb4194efc, volume: d05e81ec-6c81-4f0f-81ce-a4eb92577ee4, {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:26:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:52 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc82a8cd-fc99-4ccd-b34d-066c55a0455c]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:52 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc Jun 15 07:26:52 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:53 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc" returned: 0 in 0.842s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-906118be-3be3-4da6-b85e-fc11508c4948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:26:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:26:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Creating direct copy from snapshot {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:26:53 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[829cd9d4-a73d-4f3d-942d-d219362c1913]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:53 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 Jun 15 07:26:53 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:54 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948" returned: 0 in 1.049s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:54 devstack cinder-volume[92129]: DEBUG cinder.utils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Path /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4 not found in is_blk_device check {{(pid=92129) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:26:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:54 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4 Jun 15 07:26:54 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:58 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:26:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Flow 'volume_create_manager' (4b05ad60-2aea-4609-943f-a5b09aae55ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd94ee2c-b853-422d-8a8e-cbd59221b19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd94ee2c-b853-422d-8a8e-cbd59221b19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1730734706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa78db3f-e87b-4886-a3c1-fa219d7c5704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac00401407943fcabfbf92e4a13f20d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:58Z,use_quota=True,user_id='8cfbfcbfda2f476288dd316b81d35127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00144103-89a8-4f62-ba65-2ea2a52a3ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00144103-89a8-4f62-ba65-2ea2a52a3ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac770458-4f47-49e2-aa9e-8609d4deb880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac770458-4f47-49e2-aa9e-8609d4deb880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa78db3f-e87b-4886-a3c1-fa219d7c5704', 'volume_name': 'volume-fa78db3f-e87b-4886-a3c1-fa219d7c5704', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a717811-02e2-43f9-805c-41403ac10265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a717811-02e2-43f9-805c-41403ac10265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2410483c-6b7c-4ce5-82bb-e3386b95969d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:58 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Volume fa78db3f-e87b-4886-a3c1-fa219d7c5704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa78db3f-e87b-4886-a3c1-fa219d7c5704', 'volume_size': 1} Jun 15 07:26:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:00 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4" returned: 0 in 5.635s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:00 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[40016ea3-33f1-4419-9cb2-09de281a9784]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:00 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 Jun 15 07:27:00 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:01 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948" returned: 0 in 0.904s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:01 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Image conversion details: src /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4 {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:27:01 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Converted 1024.00 MB image at 181.69 MB/s Jun 15 07:27:01 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4 is being set with open permissions: ugo+rw Jun 15 07:27:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:01 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4 Jun 15 07:27:01 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-3754b300-e700-41e5-94a8-c61ccbd85197 req-698e8311-a902-4d15-b9fb-28b3861be1e6 tempest-TestShelveInstance-242574027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:01 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4" returned: 0 in 0.729s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:01 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4" released by "_copy_volume_from_snapshot" :: held 9.280s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:01 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Acquiring lock "cinder-quobyte-f5140010-2f99-4504-b2ae-a1aeb4194efc" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:01 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-f5140010-2f99-4504-b2ae-a1aeb4194efc" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:01 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Deleting offline snapshot f5140010-2f99-4504-b2ae-a1aeb4194efc of volume 906118be-3be3-4da6-b85e-fc11508c4948 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:27:01 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] snapshot_file for this snap is: volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:27:01 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e93769-e94c-4fcc-abb2-7b344651bfd5]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:02 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc Jun 15 07:27:02 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:02 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc" returned: 0 in 0.753s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-906118be-3be3-4da6-b85e-fc11508c4948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:27:02 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c20d3d-5ee6-4e07-9d0b-6c33d736659b]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:02 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 Jun 15 07:27:02 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:03 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948" returned: 0 in 0.755s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:03 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc Jun 15 07:27:03 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:04 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc" returned: 0 in 0.731s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:04 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc Jun 15 07:27:04 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:04 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948.f5140010-2f99-4504-b2ae-a1aeb4194efc" returned: 0 in 0.669s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-f5140010-2f99-4504-b2ae-a1aeb4194efc" released by "_delete_snapshot" :: held 3.024s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.689s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.390s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1730734706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa78db3f-e87b-4886-a3c1-fa219d7c5704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac00401407943fcabfbf92e4a13f20d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:58Z,use_quota=True,user_id='8cfbfcbfda2f476288dd316b81d35127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:27:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Creating volume fa78db3f-e87b-4886-a3c1-fa219d7c5704 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:27:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:27:04 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:27:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fa78db3f-e87b-4886-a3c1-fa219d7c5704 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:05 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fa78db3f-e87b-4886-a3c1-fa219d7c5704 1073741824 Jun 15 07:27:05 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78b8a2d-940a-41a8-970c-75a7349081c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4', 'volume_size': 1, 'source_volid': '906118be-3be3-4da6-b85e-fc11508c4948', 'source_volstatus': 'available'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:05 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:05 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2c59b8-a0c0-41b2-9616-847b86474c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:05 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Volume volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4 (d05e81ec-6c81-4f0f-81ce-a4eb92577ee4): created successfully Jun 15 07:27:05 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2c59b8-a0c0-41b2-9616-847b86474c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:05 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Flow 'volume_create_manager' (9d6eb325-46c7-4578-a71a-2903ef44fbea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:05 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-fbc0d2b0-0c2b-475f-838a-b07608d117ed tempest-VolumesGetTest-823806120 None] Created volume successfully. Jun 15 07:27:05 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fa78db3f-e87b-4886-a3c1-fa219d7c5704 1073741824" returned: 0 in 0.798s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fa78db3f-e87b-4886-a3c1-fa219d7c5704 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:05 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fa78db3f-e87b-4886-a3c1-fa219d7c5704 Jun 15 07:27:05 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:06 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fa78db3f-e87b-4886-a3c1-fa219d7c5704" returned: 0 in 0.631s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-3754b300-e700-41e5-94a8-c61ccbd85197 req-698e8311-a902-4d15-b9fb-28b3861be1e6 tempest-TestShelveInstance-242574027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.992s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2410483c-6b7c-4ce5-82bb-e3386b95969d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa78db3f-e87b-4886-a3c1-fa219d7c5704', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49fa8b8-1e1f-4873-acac-229a303ac4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:06 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Volume volume-fa78db3f-e87b-4886-a3c1-fa219d7c5704 (fa78db3f-e87b-4886-a3c1-fa219d7c5704): created successfully Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49fa8b8-1e1f-4873-acac-229a303ac4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Flow 'volume_create_manager' (4b05ad60-2aea-4609-943f-a5b09aae55ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc1c494-b783-4711-bc2a-9db7b6744ec7]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-3754b300-e700-41e5-94a8-c61ccbd85197 req-698e8311-a902-4d15-b9fb-28b3861be1e6 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:06 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c2bfa42e-ba99-4d87-bb04-3cb9ef73686a tempest-VolumesMetadataTest-615688264 None] Created volume successfully. Jun 15 07:27:06 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a Jun 15 07:27:06 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Flow 'volume_create_manager' (51e551aa-4ee4-4b02-990d-5a82faaab000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb0c73a-aeeb-4ffb-9497-60bd5a273c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb0c73a-aeeb-4ffb-9497-60bd5a273c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-152424506',display_name='tempest-VolumesGetTest-Volume-1982676089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebaf7684-aeba-4ba0-b15e-c7bac40da3ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb335354c01e4c0f81c62a8315f06c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:07Z,use_quota=True,user_id='4b0d93b3699640a4bc6fd12c350687fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134ec28f-a8c5-4c4b-8fa4-aba183a76f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134ec28f-a8c5-4c4b-8fa4-aba183a76f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c896bb4c-dd84-42f8-a580-1eb89f59c13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c896bb4c-dd84-42f8-a580-1eb89f59c13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebaf7684-aeba-4ba0-b15e-c7bac40da3ab', 'volume_name': 'volume-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d601ee94-6ef2-4d71-83ec-a0b83191ccb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d601ee94-6ef2-4d71-83ec-a0b83191ccb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80774579-4296-4fcb-bea2-4c83d5a4b3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:06 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Volume ebaf7684-aeba-4ba0-b15e-c7bac40da3ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab', 'volume_size': 1} Jun 15 07:27:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:07 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-3754b300-e700-41e5-94a8-c61ccbd85197 req-698e8311-a902-4d15-b9fb-28b3861be1e6 tempest-TestShelveInstance-242574027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a" returned: 0 in 0.820s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-3754b300-e700-41e5-94a8-c61ccbd85197 req-698e8311-a902-4d15-b9fb-28b3861be1e6 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:07 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a Jun 15 07:27:07 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Flow 'volume_create_manager' (2793cffd-dc59-4ac9-a3ad-d747c1cf287d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1478e25-ed59-49ef-a5a8-d862c387a561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] Acquiring lock "cinder-fa78db3f-e87b-4886-a3c1-fa219d7c5704-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1478e25-ed59-49ef-a5a8-d862c387a561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-693938891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d02bc41-7371-489f-b0bc-b5f68f945213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff65c34fd7914f77aaa87de78d029b06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:08Z,use_quota=True,user_id='6fd50b837aa94058855e6f8e8c9a5dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9858588-d68f-461f-9d39-5764289eb62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9858588-d68f-461f-9d39-5764289eb62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470be9a7-056f-4475-9a68-d49d56ccc361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470be9a7-056f-4475-9a68-d49d56ccc361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d02bc41-7371-489f-b0bc-b5f68f945213', 'volume_name': 'volume-4d02bc41-7371-489f-b0bc-b5f68f945213', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1ee737-7040-413f-a955-4a5a4cc9f6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1ee737-7040-413f-a955-4a5a4cc9f6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4023491b-c675-4328-82c5-901100132df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:08 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Volume 4d02bc41-7371-489f-b0bc-b5f68f945213: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d02bc41-7371-489f-b0bc-b5f68f945213', 'volume_size': 1} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] Lock "cinder-fa78db3f-e87b-4886-a3c1-fa219d7c5704-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:08 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-3754b300-e700-41e5-94a8-c61ccbd85197 req-698e8311-a902-4d15-b9fb-28b3861be1e6 tempest-TestShelveInstance-242574027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a" returned: 1 in 0.873s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-3754b300-e700-41e5-94a8-c61ccbd85197 req-698e8311-a902-4d15-b9fb-28b3861be1e6 tempest-TestShelveInstance-242574027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-3754b300-e700-41e5-94a8-c61ccbd85197 req-698e8311-a902-4d15-b9fb-28b3861be1e6 tempest-TestShelveInstance-242574027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.757s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.471s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-152424506',display_name='tempest-VolumesGetTest-Volume-1982676089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebaf7684-aeba-4ba0-b15e-c7bac40da3ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb335354c01e4c0f81c62a8315f06c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:07Z,use_quota=True,user_id='4b0d93b3699640a4bc6fd12c350687fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Creating volume ebaf7684-aeba-4ba0-b15e-c7bac40da3ab {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:27:08 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] Acquiring lock "cinder-quobyte-fa78db3f-e87b-4886-a3c1-fa219d7c5704" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:08 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab 1073741824 Jun 15 07:27:08 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] Lock "cinder-quobyte-fa78db3f-e87b-4886-a3c1-fa219d7c5704" acquired by "delete_volume" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-3754b300-e700-41e5-94a8-c61ccbd85197 req-698e8311-a902-4d15-b9fb-28b3861be1e6 tempest-TestShelveInstance-242574027 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-31d12f77-e0d2-4639-92ca-87a15b00f73a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8cb6454-3ac0-4db3-a045-6bba12ec329b', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfb9b48-85aa-46ca-92e0-064b8ee101a8]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fa78db3f-e87b-4886-a3c1-fa219d7c5704 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:08 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-3754b300-e700-41e5-94a8-c61ccbd85197 req-698e8311-a902-4d15-b9fb-28b3861be1e6 tempest-TestShelveInstance-242574027 None] attachment_update completed successfully. Jun 15 07:27:08 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fa78db3f-e87b-4886-a3c1-fa219d7c5704 Jun 15 07:27:08 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:09 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab 1073741824" returned: 0 in 0.855s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:09 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fa78db3f-e87b-4886-a3c1-fa219d7c5704" returned: 0 in 0.819s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fa78db3f-e87b-4886-a3c1-fa219d7c5704 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:09 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab Jun 15 07:27:09 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:09 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fa78db3f-e87b-4886-a3c1-fa219d7c5704 Jun 15 07:27:09 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:09 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:09 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-fa78db3f-e87b-4886-a3c1-fa219d7c5704" returned: 0 in 0.632s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab" returned: 0 in 0.655s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.620s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-693938891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d02bc41-7371-489f-b0bc-b5f68f945213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff65c34fd7914f77aaa87de78d029b06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:08Z,use_quota=True,user_id='6fd50b837aa94058855e6f8e8c9a5dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Creating volume 4d02bc41-7371-489f-b0bc-b5f68f945213 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:27:09 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4d02bc41-7371-489f-b0bc-b5f68f945213 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] Lock "cinder-quobyte-fa78db3f-e87b-4886-a3c1-fa219d7c5704" released by "delete_volume" :: held 1.535s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:09 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4d02bc41-7371-489f-b0bc-b5f68f945213 1073741824 Jun 15 07:27:09 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80774579-4296-4fcb-bea2-4c83d5a4b3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1533449-d724-499b-ba9a-fdf20b46af9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:09 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Volume volume-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab (ebaf7684-aeba-4ba0-b15e-c7bac40da3ab): created successfully Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1533449-d724-499b-ba9a-fdf20b46af9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Flow 'volume_create_manager' (51e551aa-4ee4-4b02-990d-5a82faaab000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:09 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-4e2803c5-4ee2-4b58-8455-d42edcc569eb tempest-VolumesGetTest-823806120 None] Created volume successfully. Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] Created reservations ['f3faedf8-46e2-4554-a1fd-5e0faf53a26a', 'd5bb8d8e-315d-4f1c-a881-c0d7d91c55ca', '1dad5126-8e4b-4d1d-ac5f-9ccb957c4e30', '6e7f5ba0-d77c-4e90-b245-55188084d8ce'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:10 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:27:10 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] Acquiring lock "cinder-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] Lock "cinder-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] Acquiring lock "cinder-quobyte-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab" acquired by "delete_volume" :: waited 0.030s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:10 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7216e2-c058-4052-90ce-c0aab0d9573f]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:10 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab Jun 15 07:27:10 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:10 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.874s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:10 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:10 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] Deleted volume successfully. Jun 15 07:27:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-838a5522-71cd-4bc4-8aee-385dcf0c9d9e tempest-VolumesMetadataTest-615688264 None] Lock "cinder-fa78db3f-e87b-4886-a3c1-fa219d7c5704-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:10 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4d02bc41-7371-489f-b0bc-b5f68f945213 1073741824" returned: 0 in 1.157s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4d02bc41-7371-489f-b0bc-b5f68f945213 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:11 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4d02bc41-7371-489f-b0bc-b5f68f945213 Jun 15 07:27:11 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:11 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab" returned: 0 in 0.952s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:11 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab Jun 15 07:27:11 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:11 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4d02bc41-7371-489f-b0bc-b5f68f945213" returned: 0 in 0.761s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:27:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4023491b-c675-4328-82c5-901100132df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d02bc41-7371-489f-b0bc-b5f68f945213', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5f2d39-4bc0-435c-881b-cec3ec26f711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:11 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Volume volume-4d02bc41-7371-489f-b0bc-b5f68f945213 (4d02bc41-7371-489f-b0bc-b5f68f945213): created successfully Jun 15 07:27:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5f2d39-4bc0-435c-881b-cec3ec26f711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Flow 'volume_create_manager' (2793cffd-dc59-4ac9-a3ad-d747c1cf287d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:11 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-3fa190a8-5f52-49fc-bad7-c4e82c9efd09 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Created volume successfully. Jun 15 07:27:12 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab" returned: 0 in 0.815s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab" released by "delete_volume" :: held 1.847s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:12 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] Created reservations ['d3fbe930-bdc2-4b82-b214-e3bc4a22069e', 'db69731f-3ba7-4df9-854b-3fb1c973739f', '04947a88-9b34-4c1b-92ad-7a4be8a2a558', '8aa2dfa2-9812-46a0-800b-3b73665a8670'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:12 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:12 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:12 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:27:12 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] Acquiring lock "cinder-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] Lock "cinder-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] Acquiring lock "cinder-quobyte-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4" acquired by "delete_volume" :: waited 0.016s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:13 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4fdb83-f783-4fd1-9a1d-2c13e263a03a]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:13 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4 Jun 15 07:27:13 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:13 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.792s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:13 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:13 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] Deleted volume successfully. Jun 15 07:27:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c3335e91-1ac3-4c5f-a445-942ad8c8e2bd tempest-VolumesGetTest-823806120 None] Lock "cinder-ebaf7684-aeba-4ba0-b15e-c7bac40da3ab-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:27:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:14 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:27:14 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:14 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4" returned: 0 in 1.478s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:14 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4 Jun 15 07:27:14 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:15 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.163s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:15 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:15 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:27:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 28 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:27:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:27:15 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4" returned: 0 in 1.118s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4" released by "delete_volume" :: held 2.655s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:15 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] Created reservations ['0c5d89eb-f09f-4732-8ab0-0fb6f3148d6b', 'cb206cb5-0aa8-4ad0-b8f8-52382846b1a4', 'b9b7c8bc-8741-4a75-a192-658bd0055b6f', 'de715428-d409-40dd-b72e-27c87b18d114'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:15 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:15 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:16 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:27:16 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-38f97414-86c9-4935-87d8-bbaf038da9ae req-b68baf01-8c28-4da7-990f-694447fd7419 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-38f97414-86c9-4935-87d8-bbaf038da9ae req-b68baf01-8c28-4da7-990f-694447fd7419 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:16 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[042b590e-e67a-4101-87d0-b48f6d005daa]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-38f97414-86c9-4935-87d8-bbaf038da9ae req-b68baf01-8c28-4da7-990f-694447fd7419 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4d02bc41-7371-489f-b0bc-b5f68f945213 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:16 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4d02bc41-7371-489f-b0bc-b5f68f945213 Jun 15 07:27:16 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Flow 'volume_create_manager' (8281971c-021d-4040-bad7-7814b62f633f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d61e61-1771-4a5b-94bb-f8fb5c8a2869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d61e61-1771-4a5b-94bb-f8fb5c8a2869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-365264210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b85d5ce-7f3b-4914-b91b-dfe89475655f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aca3645ced8540858b72b9dab9a75612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:17Z,use_quota=True,user_id='a650c5a13441442fbe36585ea769245e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:17 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bee5f91-a396-4e15-81bf-1cb0d71cfa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bee5f91-a396-4e15-81bf-1cb0d71cfa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abc4e1e-07a0-45d5-a942-c886a9f66a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abc4e1e-07a0-45d5-a942-c886a9f66a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b85d5ce-7f3b-4914-b91b-dfe89475655f', 'volume_name': 'volume-0b85d5ce-7f3b-4914-b91b-dfe89475655f', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3101b2cb-8acb-4b80-9d38-c459336a6f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3101b2cb-8acb-4b80-9d38-c459336a6f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31fb056-6650-478d-9b49-774d3b0e81d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:17 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Volume 0b85d5ce-7f3b-4914-b91b-dfe89475655f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b85d5ce-7f3b-4914-b91b-dfe89475655f', 'volume_size': 1} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] Acquiring lock "cinder-906118be-3be3-4da6-b85e-fc11508c4948-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.640s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:17 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] Deleted volume successfully. Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] Lock "cinder-906118be-3be3-4da6-b85e-fc11508c4948-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3c61fe4f-697e-4f4d-a89e-5bdcab0445c4 tempest-VolumesGetTest-823806120 None] Lock "cinder-d05e81ec-6c81-4f0f-81ce-a4eb92577ee4-delete_volume" released by "delete_volume" :: held 4.851s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] Acquiring lock "cinder-quobyte-906118be-3be3-4da6-b85e-fc11508c4948" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-906118be-3be3-4da6-b85e-fc11508c4948" acquired by "delete_volume" :: waited 0.034s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6574ce-9a23-43b5-890b-768b5f853536]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:18 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 Jun 15 07:27:18 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:18 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-38f97414-86c9-4935-87d8-bbaf038da9ae req-b68baf01-8c28-4da7-990f-694447fd7419 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4d02bc41-7371-489f-b0bc-b5f68f945213" returned: 0 in 1.814s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-38f97414-86c9-4935-87d8-bbaf038da9ae req-b68baf01-8c28-4da7-990f-694447fd7419 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.854s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.779s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-365264210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b85d5ce-7f3b-4914-b91b-dfe89475655f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aca3645ced8540858b72b9dab9a75612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:17Z,use_quota=True,user_id='a650c5a13441442fbe36585ea769245e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:27:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Creating volume 0b85d5ce-7f3b-4914-b91b-dfe89475655f {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:27:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:27:18 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:27:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0b85d5ce-7f3b-4914-b91b-dfe89475655f 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:18 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0b85d5ce-7f3b-4914-b91b-dfe89475655f 1073741824 Jun 15 07:27:18 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-38f97414-86c9-4935-87d8-bbaf038da9ae req-b68baf01-8c28-4da7-990f-694447fd7419 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-4d02bc41-7371-489f-b0bc-b5f68f945213', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6485a22-0eb2-40e5-9a3f-c5bf2975e948', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:27:18 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-38f97414-86c9-4935-87d8-bbaf038da9ae req-b68baf01-8c28-4da7-990f-694447fd7419 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] attachment_update completed successfully. Jun 15 07:27:19 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948" returned: 0 in 1.553s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:19 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948 Jun 15 07:27:19 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:20 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0b85d5ce-7f3b-4914-b91b-dfe89475655f 1073741824" returned: 0 in 1.869s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0b85d5ce-7f3b-4914-b91b-dfe89475655f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:20 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0b85d5ce-7f3b-4914-b91b-dfe89475655f Jun 15 07:27:20 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:20 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-906118be-3be3-4da6-b85e-fc11508c4948" returned: 0 in 1.004s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-906118be-3be3-4da6-b85e-fc11508c4948" released by "delete_volume" :: held 2.641s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:20 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] Created reservations ['e577814a-e534-4584-ac9c-a7667d7885b7', 'f37df3b2-6388-4697-a1b8-08dca28024c7', '313634fa-d545-4b68-8e28-ded46ea99762', '813e2d2a-f4a9-42b7-9446-f0e850f78e28'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:20 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:27:20 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:21 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0b85d5ce-7f3b-4914-b91b-dfe89475655f" returned: 0 in 0.865s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] <== create_volume: return (2810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:27:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.817s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31fb056-6650-478d-9b49-774d3b0e81d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b85d5ce-7f3b-4914-b91b-dfe89475655f', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb28451-cda4-40a1-b6b1-d8b5c32600be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:21 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Volume volume-0b85d5ce-7f3b-4914-b91b-dfe89475655f (0b85d5ce-7f3b-4914-b91b-dfe89475655f): created successfully Jun 15 07:27:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb28451-cda4-40a1-b6b1-d8b5c32600be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Flow 'volume_create_manager' (8281971c-021d-4040-bad7-7814b62f633f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:21 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-454c974a-de98-4405-860e-59f80a08c1c3 tempest-VolumesTransfersTest-1705912154 None] Created volume successfully. Jun 15 07:27:21 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.005s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:21 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:21 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] Deleted volume successfully. Jun 15 07:27:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3a032664-11e4-4758-a9a2-895748cd3f25 tempest-VolumesGetTest-823806120 None] Lock "cinder-906118be-3be3-4da6-b85e-fc11508c4948-delete_volume" released by "delete_volume" :: held 4.134s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:22 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:27:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Flow 'volume_create_manager' (611518d3-71a6-4cd1-9c33-383e4f573e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d388f1-b0c7-4686-9240-274ef4a9e41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d388f1-b0c7-4686-9240-274ef4a9e41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1591342414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a09f0889-f733-4925-9c78-7583e95a3714,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fb335354c01e4c0f81c62a8315f06c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:22Z,use_quota=True,user_id='4b0d93b3699640a4bc6fd12c350687fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc410b72-8ec9-4f33-a255-fffec572f120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc410b72-8ec9-4f33-a255-fffec572f120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1d5cf7-816e-4d59-ba39-09778be02a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:22 devstack cinder-volume[92129]: DEBUG cinder.image.glance [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Creating Keystone auth plugin from conf {{(pid=92129) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:27:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1d5cf7-816e-4d59-ba39-09778be02a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a09f0889-f733-4925-9c78-7583e95a3714', 'volume_name': 'volume-a09f0889-f733-4925-9c78-7583e95a3714', 'volume_size': 1, 'image_id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0d4c76bb4c8424fbbbc7d856674ea3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'created_at': datetime.datetime(2026, 6, 15, 5, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af781faa-2398-41b5-9cb2-cfe0761734f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba5beca-753c-4698-9bc9-c9668721b555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba5beca-753c-4698-9bc9-c9668721b555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ae1d9d-96df-4c1d-8198-765dad64baf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:22 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Volume a09f0889-f733-4925-9c78-7583e95a3714: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a09f0889-f733-4925-9c78-7583e95a3714', 'volume_size': 1, 'image_id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0d4c76bb4c8424fbbbc7d856674ea3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'created_at': datetime.datetime(2026, 6, 15, 5, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af781faa-2398-41b5-9cb2-cfe0761734f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 15 07:27:22 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Trying to clone a09f0889-f733-4925-9c78-7583e95a3714 from image af781faa-2398-41b5-9cb2-cfe0761734f9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}]). {{(pid=92129) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:27:23 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:UPDATE=99,cinder:SELECT=84,cinder:INSERT=31,cinder:DELETE=11 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:27:23 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-8b572bb6-ac53-4ffb-bc5d-d10f2309ef9e tempest-VolumesTransfersTest-1252037376 None] Transfer volume completed successfully. Jun 15 07:27:23 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_irxyjq5edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:27:23 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Image download 20.69 MB at 20.69 MB/s Jun 15 07:27:23 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d45dd23-960d-4e4b-958d-4c6728253c11]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_irxyjq5edevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:23 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_irxyjq5edevstack@QuobyteHD Jun 15 07:27:23 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] Acquiring lock "cinder-0b85d5ce-7f3b-4914-b91b-dfe89475655f-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] Lock "cinder-0b85d5ce-7f3b-4914-b91b-dfe89475655f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] Acquiring lock "cinder-quobyte-0b85d5ce-7f3b-4914-b91b-dfe89475655f" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] Lock "cinder-quobyte-0b85d5ce-7f3b-4914-b91b-dfe89475655f" acquired by "delete_volume" :: waited 0.032s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:24 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9fe28d-40ed-4c53-a5d0-5a64497cb6d1]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0b85d5ce-7f3b-4914-b91b-dfe89475655f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:24 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0b85d5ce-7f3b-4914-b91b-dfe89475655f Jun 15 07:27:24 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:25 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_irxyjq5edevstack@QuobyteHD" returned: 0 in 1.226s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:25 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Temporary image af781faa-2398-41b5-9cb2-cfe0761734f9 is fetched for user 4b0d93b3699640a4bc6fd12c350687fd. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:27:25 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7472ec39-0d3b-444d-8d8a-4022cd1ccd74]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_irxyjq5edevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:25 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_irxyjq5edevstack@QuobyteHD Jun 15 07:27:25 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:25 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0b85d5ce-7f3b-4914-b91b-dfe89475655f" returned: 0 in 1.130s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0b85d5ce-7f3b-4914-b91b-dfe89475655f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:25 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0b85d5ce-7f3b-4914-b91b-dfe89475655f Jun 15 07:27:25 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:25 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_irxyjq5edevstack@QuobyteHD" returned: 0 in 0.850s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1591342414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a09f0889-f733-4925-9c78-7583e95a3714,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fb335354c01e4c0f81c62a8315f06c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:22Z,use_quota=True,user_id='4b0d93b3699640a4bc6fd12c350687fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:27:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Creating volume a09f0889-f733-4925-9c78-7583e95a3714 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:27:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:27:26 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:27:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:26 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 1073741824 Jun 15 07:27:26 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:26 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0b85d5ce-7f3b-4914-b91b-dfe89475655f" returned: 0 in 0.704s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] Lock "cinder-quobyte-0b85d5ce-7f3b-4914-b91b-dfe89475655f" released by "delete_volume" :: held 1.902s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:26 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] Created reservations ['d182fe54-12f4-4329-87db-5e44532ac670', '0fd34656-6c4e-45e7-85e3-75b04a9893c8', 'cd4141bd-e3a2-426d-a992-18a779b87f0b', '89e2849f-acd1-49ae-b8c8-d4d99b98ba17'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:26 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:27:26 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:26 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-c5f7fa00-185c-4cf6-a0e8-9161ed0cebca req-51fd7948-9eda-4974-a9c2-9850e5cbaf32 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Terminate volume connection completed successfully. Jun 15 07:27:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-c5f7fa00-185c-4cf6-a0e8-9161ed0cebca req-51fd7948-9eda-4974-a9c2-9850e5cbaf32 tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Deleting attachment b6485a22-0eb2-40e5-9a3f-c5bf2975e948. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:27:27 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 1073741824" returned: 0 in 1.239s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:27 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.730s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:27 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:27 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] Deleted volume successfully. Jun 15 07:27:27 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 Jun 15 07:27:27 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:27 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:27:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Flow 'volume_create_manager' (a1e59747-b443-4729-af7b-a75eae172c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a10f811-f027-46bc-a076-5e9393700cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-37f6a69c-83cc-4316-936d-17781899af85 tempest-VolumesTransfersTest-836470531 None] Lock "cinder-0b85d5ce-7f3b-4914-b91b-dfe89475655f-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a10f811-f027-46bc-a076-5e9393700cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1588899231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ab01b5-6766-46ad-9bf3-8bb2143a54ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aca3645ced8540858b72b9dab9a75612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:27Z,use_quota=True,user_id='a650c5a13441442fbe36585ea769245e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907ae329-672e-4d88-9e20-97592313f2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907ae329-672e-4d88-9e20-97592313f2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414a1bc3-51bf-40d0-a773-4834690018d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414a1bc3-51bf-40d0-a773-4834690018d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ab01b5-6766-46ad-9bf3-8bb2143a54ac', 'volume_name': 'volume-63ab01b5-6766-46ad-9bf3-8bb2143a54ac', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e891bb8-d8eb-4ac4-94dd-d94adfedc8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e891bb8-d8eb-4ac4-94dd-d94adfedc8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b3aef6-b906-4913-afce-7102de9680b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:27 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Volume 63ab01b5-6766-46ad-9bf3-8bb2143a54ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ab01b5-6766-46ad-9bf3-8bb2143a54ac', 'volume_size': 1} Jun 15 07:27:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:28 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714" returned: 0 in 0.726s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.513s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1588899231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ab01b5-6766-46ad-9bf3-8bb2143a54ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aca3645ced8540858b72b9dab9a75612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:27Z,use_quota=True,user_id='a650c5a13441442fbe36585ea769245e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Creating volume 63ab01b5-6766-46ad-9bf3-8bb2143a54ac {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:27:28 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-63ab01b5-6766-46ad-9bf3-8bb2143a54ac 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=97,cinder:UPDATE=98,cinder:DELETE=6,cinder:INSERT=38 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:27:28 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-63ab01b5-6766-46ad-9bf3-8bb2143a54ac 1073741824 Jun 15 07:27:28 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Attempting download of af781faa-2398-41b5-9cb2-cfe0761734f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}])) to volume a09f0889-f733-4925-9c78-7583e95a3714. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be6df78-aaed-4380-b8da-d9450527f340]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_w12qk5hh {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:28 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_w12qk5hh Jun 15 07:27:28 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Acquiring lock "cinder-4d02bc41-7371-489f-b0bc-b5f68f945213-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:28 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_w12qk5hh" returned: 0 in 0.852s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_w12qk5hh {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:29 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Lock "cinder-4d02bc41-7371-489f-b0bc-b5f68f945213-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:29 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Acquiring lock "cinder-quobyte-4d02bc41-7371-489f-b0bc-b5f68f945213" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:29 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Lock "cinder-quobyte-4d02bc41-7371-489f-b0bc-b5f68f945213" acquired by "delete_volume" :: waited 0.023s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:29 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_w12qk5hh Jun 15 07:27:29 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:29 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcd5dc4-4dd8-4353-a24f-cdcc3b7cb264]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4d02bc41-7371-489f-b0bc-b5f68f945213 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:29 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-63ab01b5-6766-46ad-9bf3-8bb2143a54ac 1073741824" returned: 0 in 1.117s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-63ab01b5-6766-46ad-9bf3-8bb2143a54ac {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:29 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-63ab01b5-6766-46ad-9bf3-8bb2143a54ac Jun 15 07:27:29 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:29 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4d02bc41-7371-489f-b0bc-b5f68f945213 Jun 15 07:27:29 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:29 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_w12qk5hh" returned: 1 in 0.740s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af781faa-2398-41b5-9cb2-cfe0761734f9_w12qk5hh' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:27:29 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[70aa51a5-1e10-4987-9e16-df94cd6e8226]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_irxyjq5edevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:29 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_irxyjq5edevstack@QuobyteHD Jun 15 07:27:29 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:30 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4d02bc41-7371-489f-b0bc-b5f68f945213" returned: 0 in 0.883s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4d02bc41-7371-489f-b0bc-b5f68f945213 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:30 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4d02bc41-7371-489f-b0bc-b5f68f945213 Jun 15 07:27:30 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:30 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-63ab01b5-6766-46ad-9bf3-8bb2143a54ac" returned: 0 in 0.913s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b3aef6-b906-4913-afce-7102de9680b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ab01b5-6766-46ad-9bf3-8bb2143a54ac', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9272490-6d6b-4dc6-979d-8aeca4ec781f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:30 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Volume volume-63ab01b5-6766-46ad-9bf3-8bb2143a54ac (63ab01b5-6766-46ad-9bf3-8bb2143a54ac): created successfully Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9272490-6d6b-4dc6-979d-8aeca4ec781f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Flow 'volume_create_manager' (a1e59747-b443-4729-af7b-a75eae172c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:30 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-d44bea2f-5740-4cde-9e3b-94b65d7f1bbe tempest-VolumesTransfersTest-1705912154 None] Created volume successfully. Jun 15 07:27:30 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_irxyjq5edevstack@QuobyteHD" returned: 0 in 0.863s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] af781faa-2398-41b5-9cb2-cfe0761734f9 was qcow2, converting to raw {{(pid=92129) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_irxyjq5edevstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:30 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_irxyjq5edevstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 Jun 15 07:27:30 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:30 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4d02bc41-7371-489f-b0bc-b5f68f945213" returned: 0 in 0.707s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Lock "cinder-quobyte-4d02bc41-7371-489f-b0bc-b5f68f945213" released by "delete_volume" :: held 1.677s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Created reservations ['5d4a632d-5d95-4468-a0be-37d356279494', '80ad710c-2c5f-4cc0-8fc6-34aa87527358', '4ea79379-ab19-485d-8823-28c5a02988c8', 'c903b455-5960-4489-8542-e27020e9968d'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:31 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:27:31 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] Acquiring lock "cinder-63ab01b5-6766-46ad-9bf3-8bb2143a54ac-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] Lock "cinder-63ab01b5-6766-46ad-9bf3-8bb2143a54ac-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] Acquiring lock "cinder-quobyte-63ab01b5-6766-46ad-9bf3-8bb2143a54ac" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] Lock "cinder-quobyte-63ab01b5-6766-46ad-9bf3-8bb2143a54ac" acquired by "delete_volume" :: waited 0.018s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:31 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[43881ab7-876b-41a7-ab32-ae13f1c1ea9a]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-63ab01b5-6766-46ad-9bf3-8bb2143a54ac {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:31 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-63ab01b5-6766-46ad-9bf3-8bb2143a54ac Jun 15 07:27:31 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:31 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.022s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:32 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:32 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Deleted volume successfully. Jun 15 07:27:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-73cfdd6a-2c26-4560-ad51-a15a024c58cc tempest-TestServerVolumeAttachScenarioOldVersion-1272246488 None] Lock "cinder-4d02bc41-7371-489f-b0bc-b5f68f945213-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:32 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-63ab01b5-6766-46ad-9bf3-8bb2143a54ac" returned: 0 in 1.055s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-63ab01b5-6766-46ad-9bf3-8bb2143a54ac {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:32 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-63ab01b5-6766-46ad-9bf3-8bb2143a54ac Jun 15 07:27:32 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:33 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-63ab01b5-6766-46ad-9bf3-8bb2143a54ac" returned: 0 in 0.833s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:33 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] Lock "cinder-quobyte-63ab01b5-6766-46ad-9bf3-8bb2143a54ac" released by "delete_volume" :: held 1.964s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:33 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] Created reservations ['ba1a2388-3139-4849-896c-0218d53c091e', 'cf67af18-566f-4a3b-a2c0-33f48d9963e3', '6b2a88f2-8a6a-4998-944c-a535aa2f63ac', '6bff0e7a-e7f1-4849-b19f-03c632bc5d40'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:33 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:27:33 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:33 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_irxyjq5edevstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714" returned: 0 in 3.053s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:33 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af781faa-2398-41b5-9cb2-cfe0761734f9_irxyjq5edevstack@QuobyteHD, size 112.00 MB, duration 3.06 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:27:33 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Converted 112.00 MB image at 36.66 MB/s Jun 15 07:27:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:33 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 1G Jun 15 07:27:33 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:34 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.805s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:34 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:34 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] Deleted volume successfully. Jun 15 07:27:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b806a309-5ea3-4c81-9fb3-a00e4718c4b1 tempest-VolumesTransfersTest-836470531 None] Lock "cinder-63ab01b5-6766-46ad-9bf3-8bb2143a54ac-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:34 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 1G" returned: 0 in 0.678s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:34 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4675e7ac-337b-4d8a-9417-bb9be7b13971]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:34 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 Jun 15 07:27:34 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:35 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714" returned: 0 in 0.881s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:35 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 Jun 15 07:27:35 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:36 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714" returned: 1 in 0.783s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:27:36 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Downloaded image af781faa-2398-41b5-9cb2-cfe0761734f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}])) to volume a09f0889-f733-4925-9c78-7583e95a3714 successfully. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:27:36 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Temporary image af781faa-2398-41b5-9cb2-cfe0761734f9 for user 4b0d93b3699640a4bc6fd12c350687fd is deleted. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:27:36 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Marking volume a09f0889-f733-4925-9c78-7583e95a3714 as bootable. {{(pid=92129) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:27:36 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Copying metadata from image af781faa-2398-41b5-9cb2-cfe0761734f9 to a09f0889-f733-4925-9c78-7583e95a3714. {{(pid=92129) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:27:36 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Creating volume glance metadata for volume a09f0889-f733-4925-9c78-7583e95a3714 backed by image af781faa-2398-41b5-9cb2-cfe0761734f9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92129) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:27:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ae1d9d-96df-4c1d-8198-765dad64baf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a09f0889-f733-4925-9c78-7583e95a3714', 'volume_size': 1, 'image_id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af781faa-2398-41b5-9cb2-cfe0761734f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0d4c76bb4c8424fbbbc7d856674ea3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af781faa-2398-41b5-9cb2-cfe0761734f9', 'created_at': datetime.datetime(2026, 6, 15, 5, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af781faa-2398-41b5-9cb2-cfe0761734f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f5535d-a62b-4d6d-ace8-7495ceae9866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:36 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Volume volume-a09f0889-f733-4925-9c78-7583e95a3714 (a09f0889-f733-4925-9c78-7583e95a3714): created successfully Jun 15 07:27:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f5535d-a62b-4d6d-ace8-7495ceae9866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Flow 'volume_create_manager' (611518d3-71a6-4cd1-9c33-383e4f573e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:36 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-dacc913a-e7f7-4907-a853-76f186d0413e tempest-VolumesGetTest-823806120 None] Created volume successfully. Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Flow 'volume_create_manager' (d63ba01f-ca48-46af-9dad-136676d8dbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d684e3c-2153-4de2-ab2f-1dcc11ee4d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d684e3c-2153-4de2-ab2f-1dcc11ee4d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1891324128',display_name='tempest-VolumesGetTest-Volume-1209446265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67fa6f43-765a-477b-afa3-547df0e89362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb335354c01e4c0f81c62a8315f06c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:37Z,use_quota=True,user_id='4b0d93b3699640a4bc6fd12c350687fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ca54fd-8ae0-4fab-8361-6176c2ffd5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ca54fd-8ae0-4fab-8361-6176c2ffd5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b02d6c-619b-4d35-af48-b45d72e9b4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b02d6c-619b-4d35-af48-b45d72e9b4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67fa6f43-765a-477b-afa3-547df0e89362', 'volume_name': 'volume-67fa6f43-765a-477b-afa3-547df0e89362', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c87564-3424-4718-b380-096d2f41b9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c87564-3424-4718-b380-096d2f41b9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a74c97-8ec6-443b-a2dd-711706d184de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:37 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Volume 67fa6f43-765a-477b-afa3-547df0e89362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67fa6f43-765a-477b-afa3-547df0e89362', 'volume_size': 1} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1891324128',display_name='tempest-VolumesGetTest-Volume-1209446265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67fa6f43-765a-477b-afa3-547df0e89362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb335354c01e4c0f81c62a8315f06c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:37Z,use_quota=True,user_id='4b0d93b3699640a4bc6fd12c350687fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Creating volume 67fa6f43-765a-477b-afa3-547df0e89362 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:27:37 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:27:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67fa6f43-765a-477b-afa3-547df0e89362 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:37 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67fa6f43-765a-477b-afa3-547df0e89362 1073741824 Jun 15 07:27:37 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:38 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67fa6f43-765a-477b-afa3-547df0e89362 1073741824" returned: 0 in 0.908s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67fa6f43-765a-477b-afa3-547df0e89362 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:38 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67fa6f43-765a-477b-afa3-547df0e89362 Jun 15 07:27:38 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:39 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67fa6f43-765a-477b-afa3-547df0e89362" returned: 0 in 0.872s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:27:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a74c97-8ec6-443b-a2dd-711706d184de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67fa6f43-765a-477b-afa3-547df0e89362', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f336c42-0db8-4d7b-b155-dbc6e0d4c9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:39 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Volume volume-67fa6f43-765a-477b-afa3-547df0e89362 (67fa6f43-765a-477b-afa3-547df0e89362): created successfully Jun 15 07:27:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f336c42-0db8-4d7b-b155-dbc6e0d4c9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Flow 'volume_create_manager' (d63ba01f-ca48-46af-9dad-136676d8dbb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:39 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-382f98ca-63cf-40ee-8f62-7da7ce9e2bd8 tempest-VolumesGetTest-823806120 None] Created volume successfully. Jun 15 07:27:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] Acquiring lock "cinder-67fa6f43-765a-477b-afa3-547df0e89362-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] Lock "cinder-67fa6f43-765a-477b-afa3-547df0e89362-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] Acquiring lock "cinder-quobyte-67fa6f43-765a-477b-afa3-547df0e89362" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-67fa6f43-765a-477b-afa3-547df0e89362" acquired by "delete_volume" :: waited 0.035s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:39 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4e314c-4562-43c2-b4b4-e01cca2491da]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67fa6f43-765a-477b-afa3-547df0e89362 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:39 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67fa6f43-765a-477b-afa3-547df0e89362 Jun 15 07:27:39 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:40 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67fa6f43-765a-477b-afa3-547df0e89362" returned: 0 in 0.791s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67fa6f43-765a-477b-afa3-547df0e89362 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:40 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67fa6f43-765a-477b-afa3-547df0e89362 Jun 15 07:27:40 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:41 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67fa6f43-765a-477b-afa3-547df0e89362" returned: 0 in 0.714s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-67fa6f43-765a-477b-afa3-547df0e89362" released by "delete_volume" :: held 1.559s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:41 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] Created reservations ['0ab0b77b-6dd6-474a-9f69-9ad795e0b929', '3f9ea749-fa91-4224-8e98-cb6411503635', 'ee25d944-a857-45c5-8e47-6b418a807b59', '6e8e6ab8-3ac4-49e5-b86b-c5982bc02d6d'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:41 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:41 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:41 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:27:41 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Acquiring lock "cinder-a09f0889-f733-4925-9c78-7583e95a3714-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Lock "cinder-a09f0889-f733-4925-9c78-7583e95a3714-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Acquiring lock "cinder-quobyte-a09f0889-f733-4925-9c78-7583e95a3714" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-a09f0889-f733-4925-9c78-7583e95a3714" acquired by "delete_volume" :: waited 0.034s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:42 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[51346b86-79b3-43e4-9d88-e651c4ed647b]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:42 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 Jun 15 07:27:42 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:42 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.111s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:42 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:42 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] Deleted volume successfully. Jun 15 07:27:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9d8cf515-9565-4364-aec3-45b38343ebd6 tempest-VolumesGetTest-823806120 None] Lock "cinder-67fa6f43-765a-477b-afa3-547df0e89362-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:43 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714" returned: 0 in 1.089s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:43 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 Jun 15 07:27:43 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:44 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714" returned: 1 in 1.092s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:27:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:44 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714 Jun 15 07:27:44 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:45 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a09f0889-f733-4925-9c78-7583e95a3714" returned: 0 in 0.795s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Lock "cinder-quobyte-a09f0889-f733-4925-9c78-7583e95a3714" released by "delete_volume" :: held 3.058s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:45 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Created reservations ['f35a0095-5f4c-4e8e-bcb9-569df08bf5e6', '3b8a8a85-62cb-41fa-8dfe-8aeee4c723c6', '34f4cd8e-0c78-43fb-8d51-47a2d627c847', 'e4d580e6-2891-4895-b9ce-60fc72737c71'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:45 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:27:45 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:46 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.893s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:46 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:46 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Deleted volume successfully. Jun 15 07:27:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-471d121b-07ec-4360-b326-32b969b92779 tempest-VolumesGetTest-823806120 None] Lock "cinder-a09f0889-f733-4925-9c78-7583e95a3714-delete_volume" released by "delete_volume" :: held 4.290s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:51 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:27:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Flow 'volume_create_manager' (8d7fdfcc-f03d-498d-988d-3e8135ca3096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4d61e5-aeb1-429d-940b-c25c07cb91f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4d61e5-aeb1-429d-940b-c25c07cb91f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-986430150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b3c17e-5cde-4f41-b7ea-7689c2da0aba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94f4a988a72b48dd81164c4e744eb056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:52Z,use_quota=True,user_id='4f735addaadd47af9816d97d20b8fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169b8b2d-1ab2-4eb0-b80b-763468301dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169b8b2d-1ab2-4eb0-b80b-763468301dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0817ee7d-efac-4314-9343-c168e97fbd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0817ee7d-efac-4314-9343-c168e97fbd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b3c17e-5cde-4f41-b7ea-7689c2da0aba', 'volume_name': 'volume-36b3c17e-5cde-4f41-b7ea-7689c2da0aba', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4427d229-6297-43e9-a8ef-da69a5ec3d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4427d229-6297-43e9-a8ef-da69a5ec3d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f93491-5303-4595-89fc-5aae2db99183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:52 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Volume 36b3c17e-5cde-4f41-b7ea-7689c2da0aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b3c17e-5cde-4f41-b7ea-7689c2da0aba', 'volume_size': 1} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-986430150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b3c17e-5cde-4f41-b7ea-7689c2da0aba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94f4a988a72b48dd81164c4e744eb056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:52Z,use_quota=True,user_id='4f735addaadd47af9816d97d20b8fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Creating volume 36b3c17e-5cde-4f41-b7ea-7689c2da0aba {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:27:52 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:27:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-36b3c17e-5cde-4f41-b7ea-7689c2da0aba 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:52 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-36b3c17e-5cde-4f41-b7ea-7689c2da0aba 1073741824 Jun 15 07:27:52 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:53 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-36b3c17e-5cde-4f41-b7ea-7689c2da0aba 1073741824" returned: 0 in 1.069s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-36b3c17e-5cde-4f41-b7ea-7689c2da0aba {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:53 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-36b3c17e-5cde-4f41-b7ea-7689c2da0aba Jun 15 07:27:53 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:54 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-36b3c17e-5cde-4f41-b7ea-7689c2da0aba" returned: 0 in 1.064s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] <== create_volume: return (2199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:27:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.203s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f93491-5303-4595-89fc-5aae2db99183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b3c17e-5cde-4f41-b7ea-7689c2da0aba', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1273e03e-cedd-439d-b773-681bfafc3dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:54 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Volume volume-36b3c17e-5cde-4f41-b7ea-7689c2da0aba (36b3c17e-5cde-4f41-b7ea-7689c2da0aba): created successfully Jun 15 07:27:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1273e03e-cedd-439d-b773-681bfafc3dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Flow 'volume_create_manager' (8d7fdfcc-f03d-498d-988d-3e8135ca3096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:54 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-22da989a-078b-4c89-8969-fcee07de1336 tempest-VolumesListTestJSON-2045654877 None] Created volume successfully. Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Flow 'volume_create_manager' (92b6b066-0ba8-4245-84e5-6d182e2f5b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5378b5fb-23f3-45ce-b3d8-eb560b214dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5378b5fb-23f3-45ce-b3d8-eb560b214dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-130155029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e48f6a3-6b47-4431-b897-d045c28aabac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='729ea502ba9f4bdeab5ee670d484bc07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:55Z,use_quota=True,user_id='8db72ef7c78e4db1ae6d1476039f533a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec66e38-7e13-4dcf-b318-5f03debd43b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec66e38-7e13-4dcf-b318-5f03debd43b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf463ea-020c-4c87-858e-085b6a675f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf463ea-020c-4c87-858e-085b6a675f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e48f6a3-6b47-4431-b897-d045c28aabac', 'volume_name': 'volume-9e48f6a3-6b47-4431-b897-d045c28aabac', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51fc4e2-6517-42b5-aa09-2c5a2c49eeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51fc4e2-6517-42b5-aa09-2c5a2c49eeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4985c14d-a71c-44f3-8796-792e8de90165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:55 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Volume 9e48f6a3-6b47-4431-b897-d045c28aabac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e48f6a3-6b47-4431-b897-d045c28aabac', 'volume_size': 1} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-130155029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e48f6a3-6b47-4431-b897-d045c28aabac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='729ea502ba9f4bdeab5ee670d484bc07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:55Z,use_quota=True,user_id='8db72ef7c78e4db1ae6d1476039f533a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Creating volume 9e48f6a3-6b47-4431-b897-d045c28aabac {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:27:55 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:27:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:55 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac 1073741824 Jun 15 07:27:55 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:56 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:27:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Flow 'volume_create_manager' (c4096276-770f-4b68-a11d-844af8346d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bef3ec-57c5-4408-b2bb-a90257022f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bef3ec-57c5-4408-b2bb-a90257022f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1479295331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e198b33-2a46-4fff-bb50-db1dc0657ba0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94f4a988a72b48dd81164c4e744eb056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:56Z,use_quota=True,user_id='4f735addaadd47af9816d97d20b8fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb07648-df86-4ae2-9e5b-ca5892b29f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb07648-df86-4ae2-9e5b-ca5892b29f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8680470-a064-4c43-bb96-7cfe7600460a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8680470-a064-4c43-bb96-7cfe7600460a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e198b33-2a46-4fff-bb50-db1dc0657ba0', 'volume_name': 'volume-9e198b33-2a46-4fff-bb50-db1dc0657ba0', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263a8180-ad63-40f6-98cf-a424261491d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263a8180-ad63-40f6-98cf-a424261491d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ae0b90-9e82-493d-ab3e-a0a06cdcb466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:56 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Volume 9e198b33-2a46-4fff-bb50-db1dc0657ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e198b33-2a46-4fff-bb50-db1dc0657ba0', 'volume_size': 1} Jun 15 07:27:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:56 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac 1073741824" returned: 0 in 1.155s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:56 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac Jun 15 07:27:56 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:56 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-6fbfc91f-1361-4c12-89cb-7da28af128a7 req-6543ed30-15b1-4904-bd0d-20b820187a45 tempest-TestShelveInstance-242574027 None] Terminate volume connection completed successfully. Jun 15 07:27:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-6fbfc91f-1361-4c12-89cb-7da28af128a7 req-6543ed30-15b1-4904-bd0d-20b820187a45 tempest-TestShelveInstance-242574027 None] Deleting attachment a8cb6454-3ac0-4db3-a045-6bba12ec329b. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:27:57 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac" returned: 0 in 0.785s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:27:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.179s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1479295331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e198b33-2a46-4fff-bb50-db1dc0657ba0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94f4a988a72b48dd81164c4e744eb056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:56Z,use_quota=True,user_id='4f735addaadd47af9816d97d20b8fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:27:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Creating volume 9e198b33-2a46-4fff-bb50-db1dc0657ba0 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:27:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:27:57 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:27:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e198b33-2a46-4fff-bb50-db1dc0657ba0 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:57 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e198b33-2a46-4fff-bb50-db1dc0657ba0 1073741824 Jun 15 07:27:57 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4985c14d-a71c-44f3-8796-792e8de90165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e48f6a3-6b47-4431-b897-d045c28aabac', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b19d6d5-b259-4f76-92e0-05a69224ba58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:57 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Volume volume-9e48f6a3-6b47-4431-b897-d045c28aabac (9e48f6a3-6b47-4431-b897-d045c28aabac): created successfully Jun 15 07:27:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b19d6d5-b259-4f76-92e0-05a69224ba58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Flow 'volume_create_manager' (92b6b066-0ba8-4245-84e5-6d182e2f5b9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:57 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-743dac8a-4597-4e74-88ec-c540bac443a7 tempest-VolumesActionsTest-329621901 None] Created volume successfully. Jun 15 07:27:58 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e198b33-2a46-4fff-bb50-db1dc0657ba0 1073741824" returned: 0 in 0.969s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e198b33-2a46-4fff-bb50-db1dc0657ba0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:58 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e198b33-2a46-4fff-bb50-db1dc0657ba0 Jun 15 07:27:58 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:59 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e198b33-2a46-4fff-bb50-db1dc0657ba0" returned: 0 in 0.684s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:27:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ae0b90-9e82-493d-ab3e-a0a06cdcb466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e198b33-2a46-4fff-bb50-db1dc0657ba0', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9271f95-a953-453d-a60d-d2e3eec4bd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:59 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Volume volume-9e198b33-2a46-4fff-bb50-db1dc0657ba0 (9e198b33-2a46-4fff-bb50-db1dc0657ba0): created successfully Jun 15 07:27:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9271f95-a953-453d-a60d-d2e3eec4bd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Flow 'volume_create_manager' (c4096276-770f-4b68-a11d-844af8346d81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:59 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-a039076f-52df-4e1f-a535-d65fd541d4d7 tempest-VolumesListTestJSON-2045654877 None] Created volume successfully. Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Flow 'volume_create_manager' (45ed5f78-62dc-474f-81f8-d23d3a79f20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b22541-c766-46cc-9c0d-526efe24753e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b22541-c766-46cc-9c0d-526efe24753e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1098432799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72c6a7c-321f-4eb0-8c97-7398d1b7403e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94f4a988a72b48dd81164c4e744eb056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:01Z,use_quota=True,user_id='4f735addaadd47af9816d97d20b8fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38eb1ef-8a50-4221-98cc-23888970388c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38eb1ef-8a50-4221-98cc-23888970388c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e1cee2-d4b2-4f4e-baf0-5da42db725f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e1cee2-d4b2-4f4e-baf0-5da42db725f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b72c6a7c-321f-4eb0-8c97-7398d1b7403e', 'volume_name': 'volume-b72c6a7c-321f-4eb0-8c97-7398d1b7403e', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23de615-fb22-4fb4-9cfb-38bbaa2c0495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23de615-fb22-4fb4-9cfb-38bbaa2c0495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87999eb4-20db-484b-864a-22b48cbaf6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:00 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Volume b72c6a7c-321f-4eb0-8c97-7398d1b7403e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b72c6a7c-321f-4eb0-8c97-7398d1b7403e', 'volume_size': 1} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1098432799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72c6a7c-321f-4eb0-8c97-7398d1b7403e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94f4a988a72b48dd81164c4e744eb056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:01Z,use_quota=True,user_id='4f735addaadd47af9816d97d20b8fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Creating volume b72c6a7c-321f-4eb0-8c97-7398d1b7403e {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:28:00 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:28:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b72c6a7c-321f-4eb0-8c97-7398d1b7403e 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:00 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b72c6a7c-321f-4eb0-8c97-7398d1b7403e 1073741824 Jun 15 07:28:00 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:01 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b72c6a7c-321f-4eb0-8c97-7398d1b7403e 1073741824" returned: 0 in 0.913s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b72c6a7c-321f-4eb0-8c97-7398d1b7403e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:01 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b72c6a7c-321f-4eb0-8c97-7398d1b7403e Jun 15 07:28:01 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:02 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b72c6a7c-321f-4eb0-8c97-7398d1b7403e" returned: 0 in 0.694s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:28:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87999eb4-20db-484b-864a-22b48cbaf6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b72c6a7c-321f-4eb0-8c97-7398d1b7403e', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90ef32d-eea4-4011-a706-676ab4223144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:02 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Volume volume-b72c6a7c-321f-4eb0-8c97-7398d1b7403e (b72c6a7c-321f-4eb0-8c97-7398d1b7403e): created successfully Jun 15 07:28:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90ef32d-eea4-4011-a706-676ab4223144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Flow 'volume_create_manager' (45ed5f78-62dc-474f-81f8-d23d3a79f20b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:02 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-72c297e2-586a-445a-af6d-00f76c17e44a tempest-VolumesListTestJSON-2045654877 None] Created volume successfully. Jun 15 07:28:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-b4ebc413-508d-4527-9cdf-294be1b459af req-801c0e02-b24d-4cbf-b4b1-1ac98ad238d4 tempest-TestShelveInstance-242574027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-b4ebc413-508d-4527-9cdf-294be1b459af req-801c0e02-b24d-4cbf-b4b1-1ac98ad238d4 tempest-TestShelveInstance-242574027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:03 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a399a211-4b6d-4b12-8aae-9e663b420c79]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-b4ebc413-508d-4527-9cdf-294be1b459af req-801c0e02-b24d-4cbf-b4b1-1ac98ad238d4 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:03 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a Jun 15 07:28:03 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:04 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-b4ebc413-508d-4527-9cdf-294be1b459af req-801c0e02-b24d-4cbf-b4b1-1ac98ad238d4 tempest-TestShelveInstance-242574027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a" returned: 0 in 0.889s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-b4ebc413-508d-4527-9cdf-294be1b459af req-801c0e02-b24d-4cbf-b4b1-1ac98ad238d4 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:04 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a Jun 15 07:28:04 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] Acquiring lock "cinder-b72c6a7c-321f-4eb0-8c97-7398d1b7403e-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] Lock "cinder-b72c6a7c-321f-4eb0-8c97-7398d1b7403e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] Acquiring lock "cinder-quobyte-b72c6a7c-321f-4eb0-8c97-7398d1b7403e" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] Lock "cinder-quobyte-b72c6a7c-321f-4eb0-8c97-7398d1b7403e" acquired by "delete_volume" :: waited 0.022s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:05 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[132bc5fc-97cf-471a-b840-a111033477b2]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b72c6a7c-321f-4eb0-8c97-7398d1b7403e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:05 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-b4ebc413-508d-4527-9cdf-294be1b459af req-801c0e02-b24d-4cbf-b4b1-1ac98ad238d4 tempest-TestShelveInstance-242574027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a" returned: 1 in 1.335s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-b4ebc413-508d-4527-9cdf-294be1b459af req-801c0e02-b24d-4cbf-b4b1-1ac98ad238d4 tempest-TestShelveInstance-242574027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:28:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-b4ebc413-508d-4527-9cdf-294be1b459af req-801c0e02-b24d-4cbf-b4b1-1ac98ad238d4 tempest-TestShelveInstance-242574027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.272s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:05 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b72c6a7c-321f-4eb0-8c97-7398d1b7403e Jun 15 07:28:05 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:05 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-b4ebc413-508d-4527-9cdf-294be1b459af req-801c0e02-b24d-4cbf-b4b1-1ac98ad238d4 tempest-TestShelveInstance-242574027 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-31d12f77-e0d2-4639-92ca-87a15b00f73a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '675f979d-0b95-4df4-bfd4-3ecac8a86cd1', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:28:05 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-b4ebc413-508d-4527-9cdf-294be1b459af req-801c0e02-b24d-4cbf-b4b1-1ac98ad238d4 tempest-TestShelveInstance-242574027 None] attachment_update completed successfully. Jun 15 07:28:06 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b72c6a7c-321f-4eb0-8c97-7398d1b7403e" returned: 0 in 0.996s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b72c6a7c-321f-4eb0-8c97-7398d1b7403e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:06 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b72c6a7c-321f-4eb0-8c97-7398d1b7403e Jun 15 07:28:06 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:07 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b72c6a7c-321f-4eb0-8c97-7398d1b7403e" returned: 0 in 0.790s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] Lock "cinder-quobyte-b72c6a7c-321f-4eb0-8c97-7398d1b7403e" released by "delete_volume" :: held 1.839s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:07 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] Created reservations ['247d06d9-2cbe-4519-bba6-0f4af94df7f3', '03c284c9-6dfc-48c5-a322-aeb9b9ca9e36', '9e0cb433-51d5-47d0-a5d4-caae852fa449', 'e4fe0ffd-74ec-4f37-91fc-3cc54418b184'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:07 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:28:07 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] Acquiring lock "cinder-9e198b33-2a46-4fff-bb50-db1dc0657ba0-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] Lock "cinder-9e198b33-2a46-4fff-bb50-db1dc0657ba0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] Acquiring lock "cinder-quobyte-9e198b33-2a46-4fff-bb50-db1dc0657ba0" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] Lock "cinder-quobyte-9e198b33-2a46-4fff-bb50-db1dc0657ba0" acquired by "delete_volume" :: waited 0.016s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:07 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67e9bbf-7c05-4893-bb25-71aa9b057294]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e198b33-2a46-4fff-bb50-db1dc0657ba0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:07 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e198b33-2a46-4fff-bb50-db1dc0657ba0 Jun 15 07:28:07 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:08 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.760s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:08 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:28:08 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] Deleted volume successfully. Jun 15 07:28:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-af6e87b6-45f0-4cbc-b97c-e3297c2b50db tempest-VolumesListTestJSON-2045654877 None] Lock "cinder-b72c6a7c-321f-4eb0-8c97-7398d1b7403e-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:08 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e198b33-2a46-4fff-bb50-db1dc0657ba0" returned: 0 in 0.867s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e198b33-2a46-4fff-bb50-db1dc0657ba0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:08 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e198b33-2a46-4fff-bb50-db1dc0657ba0 Jun 15 07:28:08 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:09 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e198b33-2a46-4fff-bb50-db1dc0657ba0" returned: 0 in 0.733s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] Lock "cinder-quobyte-9e198b33-2a46-4fff-bb50-db1dc0657ba0" released by "delete_volume" :: held 1.657s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:09 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] Created reservations ['412ae637-bd89-4e78-9b73-6a5e593b371c', 'd441076c-7e8c-4701-83cb-b3de32b8f274', 'eb7d9ef9-1e37-4758-9afb-dfb6671e4198', '9f121b0b-7563-484f-9324-7579459fd617'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:09 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:28:09 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] Acquiring lock "cinder-36b3c17e-5cde-4f41-b7ea-7689c2da0aba-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] Lock "cinder-36b3c17e-5cde-4f41-b7ea-7689c2da0aba-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] Acquiring lock "cinder-quobyte-36b3c17e-5cde-4f41-b7ea-7689c2da0aba" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] Lock "cinder-quobyte-36b3c17e-5cde-4f41-b7ea-7689c2da0aba" acquired by "delete_volume" :: waited 0.031s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:10 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbffa9f0-6c96-4434-b00d-ad535318986d]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-36b3c17e-5cde-4f41-b7ea-7689c2da0aba {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:10 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-36b3c17e-5cde-4f41-b7ea-7689c2da0aba Jun 15 07:28:10 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:10 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.802s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:10 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:28:10 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] Deleted volume successfully. Jun 15 07:28:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c81ecccf-5828-4917-8e86-901716e0e00a tempest-VolumesListTestJSON-2045654877 None] Lock "cinder-9e198b33-2a46-4fff-bb50-db1dc0657ba0-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:11 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-36b3c17e-5cde-4f41-b7ea-7689c2da0aba" returned: 0 in 0.917s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-36b3c17e-5cde-4f41-b7ea-7689c2da0aba {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:11 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-36b3c17e-5cde-4f41-b7ea-7689c2da0aba Jun 15 07:28:11 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:11 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-36b3c17e-5cde-4f41-b7ea-7689c2da0aba" returned: 0 in 0.723s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:11 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] Lock "cinder-quobyte-36b3c17e-5cde-4f41-b7ea-7689c2da0aba" released by "delete_volume" :: held 1.700s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:11 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] Created reservations ['086ae16b-2c0c-402b-92f7-5642b2288260', '1692b079-a153-49d4-89f2-879c573b93d8', '2c9c0ca2-15b5-4874-8bab-f15b9d45badb', '39fa91b5-c51e-4051-bf06-ef4d242cb201'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:11 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:28:11 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:12 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.979s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:12 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:28:12 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] Deleted volume successfully. Jun 15 07:28:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-38a55cf8-a1b5-4322-a677-34be492a05e3 tempest-VolumesListTestJSON-2045654877 None] Lock "cinder-36b3c17e-5cde-4f41-b7ea-7689c2da0aba-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:28:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:13 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:28:14 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:15 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.100s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:15 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:28:15 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:28:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 28 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:28:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:28:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0f6151ce-da9e-4111-ba6d-0d306d15cc3d tempest-VolumesActionsTest-329621901 None] Acquiring lock "cinder-9e48f6a3-6b47-4431-b897-d045c28aabac" by "attach_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0f6151ce-da9e-4111-ba6d-0d306d15cc3d tempest-VolumesActionsTest-329621901 None] Lock "cinder-9e48f6a3-6b47-4431-b897-d045c28aabac" acquired by "attach_volume" :: waited 0.030s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:16 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0f6151ce-da9e-4111-ba6d-0d306d15cc3d tempest-VolumesActionsTest-329621901 None] Attaching volume 9e48f6a3-6b47-4431-b897-d045c28aabac to instance 3deab1f1-c7c4-428f-8be1-7b5d90083d12 at mountpoint /dev/vdb on host None. Jun 15 07:28:16 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0f6151ce-da9e-4111-ba6d-0d306d15cc3d tempest-VolumesActionsTest-329621901 None] Attach volume completed successfully. Jun 15 07:28:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0f6151ce-da9e-4111-ba6d-0d306d15cc3d tempest-VolumesActionsTest-329621901 None] Lock "cinder-9e48f6a3-6b47-4431-b897-d045c28aabac" released by "attach_volume" :: held 0.139s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e132122e-1168-46dd-8831-35e7ac5f5dbf tempest-VolumesActionsTest-329621901 None] Acquiring lock "cinder-9e48f6a3-6b47-4431-b897-d045c28aabac-detach_volume" by "detach_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e132122e-1168-46dd-8831-35e7ac5f5dbf tempest-VolumesActionsTest-329621901 None] Lock "cinder-9e48f6a3-6b47-4431-b897-d045c28aabac-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:17 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-e132122e-1168-46dd-8831-35e7ac5f5dbf tempest-VolumesActionsTest-329621901 None] Detaching volume 9e48f6a3-6b47-4431-b897-d045c28aabac from instance 3deab1f1-c7c4-428f-8be1-7b5d90083d12. Jun 15 07:28:17 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-e132122e-1168-46dd-8831-35e7ac5f5dbf tempest-VolumesActionsTest-329621901 None] Detach volume completed successfully. Jun 15 07:28:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e132122e-1168-46dd-8831-35e7ac5f5dbf tempest-VolumesActionsTest-329621901 None] Lock "cinder-9e48f6a3-6b47-4431-b897-d045c28aabac-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:UPDATE=108,cinder:SELECT=79,cinder:INSERT=25,cinder:DELETE=9 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Flow 'volume_create_manager' (3df1f007-b8d1-42f5-a5b0-3ee993b22293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd1fd9a-196c-4759-a8d0-42fe34aded2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd1fd9a-196c-4759-a8d0-42fe34aded2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-233666420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becf5b11-f584-4087-a0fe-4480a2973c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dc83bfbe9a477c8cc830c976fbdd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:26Z,use_quota=True,user_id='bdd839021c0349359c880508c2adcd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad51455-5b03-409d-9d6a-79011adc1cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad51455-5b03-409d-9d6a-79011adc1cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d6bfd3-8364-4810-aef6-d8c9b41ce5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d6bfd3-8364-4810-aef6-d8c9b41ce5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'becf5b11-f584-4087-a0fe-4480a2973c7d', 'volume_name': 'volume-becf5b11-f584-4087-a0fe-4480a2973c7d', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049421a6-51f7-4928-a0d6-7e8152ff9a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049421a6-51f7-4928-a0d6-7e8152ff9a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3250aaae-d8ef-410c-b8f8-84a981d5002b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:26 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Volume becf5b11-f584-4087-a0fe-4480a2973c7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-becf5b11-f584-4087-a0fe-4480a2973c7d', 'volume_size': 1} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-233666420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becf5b11-f584-4087-a0fe-4480a2973c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dc83bfbe9a477c8cc830c976fbdd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:26Z,use_quota=True,user_id='bdd839021c0349359c880508c2adcd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Creating volume becf5b11-f584-4087-a0fe-4480a2973c7d {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:28:26 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-becf5b11-f584-4087-a0fe-4480a2973c7d 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:26 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-becf5b11-f584-4087-a0fe-4480a2973c7d 1073741824 Jun 15 07:28:26 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:26 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:28:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Flow 'volume_create_manager' (8b787974-e675-45b7-b08f-2f47f382a135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7274a766-4aa8-4f3f-952c-c54a26f27459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7274a766-4aa8-4f3f-952c-c54a26f27459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-653097043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a758694-d9c4-4d28-8e96-6928c3ce88d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dc83bfbe9a477c8cc830c976fbdd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:27Z,use_quota=True,user_id='bdd839021c0349359c880508c2adcd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0ff2c1-1c37-4195-a0dd-e8792eb891ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0ff2c1-1c37-4195-a0dd-e8792eb891ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b999e79-403e-4d19-8831-7a0914262532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b999e79-403e-4d19-8831-7a0914262532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a758694-d9c4-4d28-8e96-6928c3ce88d8', 'volume_name': 'volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85bfbb5e-6e92-4980-a9d2-c84f33e050bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85bfbb5e-6e92-4980-a9d2-c84f33e050bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5476ff-4c47-402f-bf1b-ed8d05c9cfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:27 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Volume 1a758694-d9c4-4d28-8e96-6928c3ce88d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8', 'volume_size': 1} Jun 15 07:28:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:27 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-becf5b11-f584-4087-a0fe-4480a2973c7d 1073741824" returned: 0 in 1.397s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-becf5b11-f584-4087-a0fe-4480a2973c7d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:27 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-becf5b11-f584-4087-a0fe-4480a2973c7d Jun 15 07:28:27 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:28 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-becf5b11-f584-4087-a0fe-4480a2973c7d" returned: 0 in 1.061s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] <== create_volume: return (2523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.525s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.494s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-653097043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a758694-d9c4-4d28-8e96-6928c3ce88d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dc83bfbe9a477c8cc830c976fbdd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:27Z,use_quota=True,user_id='bdd839021c0349359c880508c2adcd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Creating volume 1a758694-d9c4-4d28-8e96-6928c3ce88d8 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:28:28 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3250aaae-d8ef-410c-b8f8-84a981d5002b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-becf5b11-f584-4087-a0fe-4480a2973c7d', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731c485f-7fa7-41b2-94be-68b7e5e409a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:28 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8 1073741824 Jun 15 07:28:28 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:28 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Volume volume-becf5b11-f584-4087-a0fe-4480a2973c7d (becf5b11-f584-4087-a0fe-4480a2973c7d): created successfully Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731c485f-7fa7-41b2-94be-68b7e5e409a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Flow 'volume_create_manager' (3df1f007-b8d1-42f5-a5b0-3ee993b22293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:28 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=64,cinder:INSERT=26,cinder:UPDATE=69,cinder:DELETE=6 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:28:28 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-a2d38ee4-b1ad-4a98-b9d9-8ae9359dcca5 tempest-TestServerVolumeAttachmentScenario-699393607 None] Created volume successfully. Jun 15 07:28:30 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8 1073741824" returned: 0 in 1.385s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:30 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8 Jun 15 07:28:30 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:31 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8" returned: 0 in 0.983s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] <== create_volume: return (2444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:28:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.449s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5476ff-4c47-402f-bf1b-ed8d05c9cfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aefc342c-bc3d-4950-98e6-5974b944162b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:31 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Volume volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8 (1a758694-d9c4-4d28-8e96-6928c3ce88d8): created successfully Jun 15 07:28:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aefc342c-bc3d-4950-98e6-5974b944162b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Flow 'volume_create_manager' (8b787974-e675-45b7-b08f-2f47f382a135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:31 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0315b34a-fbdb-4afa-91cd-534dab83200e tempest-TestServerVolumeAttachmentScenario-699393607 None] Created volume successfully. Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Flow 'volume_create_manager' (160d098d-d886-4aff-8d50-1c2daf98a00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e14c3c-be67-4b78-b461-bc31f4d9d82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e14c3c-be67-4b78-b461-bc31f4d9d82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1376165896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3bb45e4a47434c9b6ebffb32f9f48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:40Z,use_quota=True,user_id='d886bd87bc664383a332813e5147ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c499c960-178b-40d7-8d6d-d820d28ebbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c499c960-178b-40d7-8d6d-d820d28ebbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce107cf-5486-47bb-82f5-5f8de0939811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce107cf-5486-47bb-82f5-5f8de0939811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b', 'volume_name': 'volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c428f578-9180-4cfe-b798-26f9d978f401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c428f578-9180-4cfe-b798-26f9d978f401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e34bca7-9b36-4ed7-a661-7bfe3452cdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:39 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Volume b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b', 'volume_size': 1} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1376165896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3bb45e4a47434c9b6ebffb32f9f48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:40Z,use_quota=True,user_id='d886bd87bc664383a332813e5147ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Creating volume b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:28:39 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:28:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:39 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b 1073741824 Jun 15 07:28:39 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:40 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b 1073741824" returned: 0 in 1.067s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:41 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b Jun 15 07:28:41 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:41 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b" returned: 0 in 0.646s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:41 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:28:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e34bca7-9b36-4ed7-a661-7bfe3452cdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be497946-0c4c-4251-a1f3-33c218108409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:41 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Volume volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b (b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b): created successfully Jun 15 07:28:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be497946-0c4c-4251-a1f3-33c218108409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Flow 'volume_create_manager' (160d098d-d886-4aff-8d50-1c2daf98a00b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:41 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-04d19c22-fc3f-41a9-873f-71c6e87d3c37 tempest-VolumesSnapshotTestJSON-1272434108 None] Created volume successfully. Jun 15 07:28:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] Creating offline snapshot f09f0351-3029-4a6f-89ac-3946a49687c5 of volume b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:28:42 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f52889-cfe3-4c4c-b1ef-f958e4be0122]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:42 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b Jun 15 07:28:42 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:43 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b" returned: 0 in 0.772s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:43 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5 1G Jun 15 07:28:43 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:43 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5 1G" returned: 0 in 0.918s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:43 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5 Jun 15 07:28:43 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:44 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5" returned: 0 in 0.722s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:44 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5 is being set with open permissions: ugo+rw Jun 15 07:28:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:44 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5 Jun 15 07:28:44 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:45 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5" returned: 0 in 0.739s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:45 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.info Jun 15 07:28:45 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:46 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.info" returned: 0 in 0.867s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:46 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.info is being set with open permissions: ugo+rw Jun 15 07:28:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:46 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.info Jun 15 07:28:46 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:48 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.info" returned: 0 in 1.790s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.002s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:48 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-82139d27-16db-4857-8512-1c77174d9b8b tempest-VolumesSnapshotTestJSON-1272434108 None] Create snapshot completed successfully Jun 15 07:28:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-f09f0351-3029-4a6f-89ac-3946a49687c5-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-f09f0351-3029-4a6f-89ac-3946a49687c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-quobyte-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b" acquired by "delete_snapshot" :: waited 0.057s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-quobyte-f09f0351-3029-4a6f-89ac-3946a49687c5" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-f09f0351-3029-4a6f-89ac-3946a49687c5" acquired by "_delete_snapshot" :: waited 0.070s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] Deleting offline snapshot f09f0351-3029-4a6f-89ac-3946a49687c5 of volume b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:28:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] snapshot_file for this snap is: volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:28:49 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b8aca7-7f65-4b52-948b-44d71e7703be]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:49 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5 Jun 15 07:28:49 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f40b0e2a-a14d-4bd1-bac6-e14873690b9e tempest-VolumesActionsTest-329621901 None] Acquiring lock "cinder-9e48f6a3-6b47-4431-b897-d045c28aabac" by "attach_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f40b0e2a-a14d-4bd1-bac6-e14873690b9e tempest-VolumesActionsTest-329621901 None] Lock "cinder-9e48f6a3-6b47-4431-b897-d045c28aabac" acquired by "attach_volume" :: waited 0.054s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:51 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f40b0e2a-a14d-4bd1-bac6-e14873690b9e tempest-VolumesActionsTest-329621901 None] Attaching volume 9e48f6a3-6b47-4431-b897-d045c28aabac to instance cb8f38bb-b5cb-4832-85f0-4de1f233e9df at mountpoint /dev/vdb on host None. Jun 15 07:28:51 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f40b0e2a-a14d-4bd1-bac6-e14873690b9e tempest-VolumesActionsTest-329621901 None] Attach volume completed successfully. Jun 15 07:28:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f40b0e2a-a14d-4bd1-bac6-e14873690b9e tempest-VolumesActionsTest-329621901 None] Lock "cinder-9e48f6a3-6b47-4431-b897-d045c28aabac" released by "attach_volume" :: held 0.240s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:51 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5" returned: 0 in 1.974s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:51 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:28:51 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4c7d28-b7b4-45cc-bf39-8da6d2d9edaa]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:51 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b Jun 15 07:28:51 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5a2aeecb-a26c-4c46-bdc0-7e3c8f5a0af7 tempest-VolumesActionsTest-329621901 None] Acquiring lock "cinder-9e48f6a3-6b47-4431-b897-d045c28aabac-detach_volume" by "detach_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5a2aeecb-a26c-4c46-bdc0-7e3c8f5a0af7 tempest-VolumesActionsTest-329621901 None] Lock "cinder-9e48f6a3-6b47-4431-b897-d045c28aabac-detach_volume" acquired by "detach_volume" :: waited 0.063s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:52 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-5a2aeecb-a26c-4c46-bdc0-7e3c8f5a0af7 tempest-VolumesActionsTest-329621901 None] Detaching volume 9e48f6a3-6b47-4431-b897-d045c28aabac from instance cb8f38bb-b5cb-4832-85f0-4de1f233e9df. Jun 15 07:28:52 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-5a2aeecb-a26c-4c46-bdc0-7e3c8f5a0af7 tempest-VolumesActionsTest-329621901 None] Detach volume completed successfully. Jun 15 07:28:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5a2aeecb-a26c-4c46-bdc0-7e3c8f5a0af7 tempest-VolumesActionsTest-329621901 None] Lock "cinder-9e48f6a3-6b47-4431-b897-d045c28aabac-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:53 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b" returned: 0 in 1.426s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:53 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5 Jun 15 07:28:53 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:54 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-5aef8016-1373-415e-a209-a1a808675bdc req-add3e2f2-d753-425d-8893-6cb4e8c9de96 tempest-TestShelveInstance-242574027 None] Terminate volume connection completed successfully. Jun 15 07:28:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-5aef8016-1373-415e-a209-a1a808675bdc req-add3e2f2-d753-425d-8893-6cb4e8c9de96 tempest-TestShelveInstance-242574027 None] Deleting attachment 675f979d-0b95-4df4-bfd4-3ecac8a86cd1. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:28:54 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5" returned: 0 in 1.621s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:54 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5 Jun 15 07:28:54 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:54 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Acquiring lock "cinder-31d12f77-e0d2-4639-92ca-87a15b00f73a-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:55 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Lock "cinder-31d12f77-e0d2-4639-92ca-87a15b00f73a-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:55 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Acquiring lock "cinder-quobyte-31d12f77-e0d2-4639-92ca-87a15b00f73a" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:55 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Lock "cinder-quobyte-31d12f77-e0d2-4639-92ca-87a15b00f73a" acquired by "delete_volume" :: waited 0.053s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:55 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14847d4-3c1b-4868-9c5e-c54d6d23371e]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:55 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a Jun 15 07:28:55 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:56 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b.f09f0351-3029-4a6f-89ac-3946a49687c5" returned: 0 in 1.792s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:56 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-f09f0351-3029-4a6f-89ac-3946a49687c5" released by "_delete_snapshot" :: held 7.209s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:56 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b" released by "delete_snapshot" :: held 7.299s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:56 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] Created reservations ['b2cc9125-5bd0-4f85-b16b-762258e96878', 'a5b1fb80-d4fc-40dd-85d8-9d0ce5cfb2d0', 'ff85b815-bac6-4c3b-8927-04a3cf6c40cf', 'e0635feb-e12e-4304-ade1-b115cf9449e7'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:56 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a" returned: 0 in 1.460s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:56 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] Delete snapshot completed successfully. Jun 15 07:28:56 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2f5590f-be74-427b-8921-bd4e349f23bf tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-f09f0351-3029-4a6f-89ac-3946a49687c5-delete_snapshot" released by "delete_snapshot" :: held 7.698s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:57 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a Jun 15 07:28:57 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Flow 'volume_create_manager' (1854ad6f-d2a4-4a20-8699-7fbf48925ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bc213c-0bf0-4b70-8705-ed5e5b29dafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bc213c-0bf0-4b70-8705-ed5e5b29dafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1154631749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec51206b-df39-4bf3-ab72-95ed866070cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3bb45e4a47434c9b6ebffb32f9f48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:58Z,use_quota=True,user_id='d886bd87bc664383a332813e5147ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68b3e66-b60c-4744-89b8-bf87339befac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68b3e66-b60c-4744-89b8-bf87339befac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce194ae-7040-4129-a3da-2194cd32487a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:58 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce194ae-7040-4129-a3da-2194cd32487a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec51206b-df39-4bf3-ab72-95ed866070cd', 'volume_name': 'volume-ec51206b-df39-4bf3-ab72-95ed866070cd', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (345835ac-7d97-4fad-8dd5-f7632fa9b472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (345835ac-7d97-4fad-8dd5-f7632fa9b472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000fb733-a4b8-4b6e-8946-6dfb1d883dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:58 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Volume ec51206b-df39-4bf3-ab72-95ed866070cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec51206b-df39-4bf3-ab72-95ed866070cd', 'volume_size': 1} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1154631749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec51206b-df39-4bf3-ab72-95ed866070cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3bb45e4a47434c9b6ebffb32f9f48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:58Z,use_quota=True,user_id='d886bd87bc664383a332813e5147ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Creating volume ec51206b-df39-4bf3-ab72-95ed866070cd {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:28:58 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a" returned: 1 in 1.484s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:28:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:58 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd 1073741824 Jun 15 07:28:58 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:58 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a Jun 15 07:28:58 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:59 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-31d12f77-e0d2-4639-92ca-87a15b00f73a" returned: 0 in 1.086s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:59 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Lock "cinder-quobyte-31d12f77-e0d2-4639-92ca-87a15b00f73a" released by "delete_volume" :: held 4.199s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:59 devstack cinder-volume[92129]: DEBUG cinder.quota [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Created reservations ['316a72fc-c40e-4fe3-be1b-8c812ab78288', 'edf95c03-f29c-48b7-a33d-3a0a00549c07', '2ed302b4-1ee8-4b05-a064-8e0bed463a06', '53467fa3-d145-49a1-80c1-4cb855edf170'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:59 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd 1073741824" returned: 0 in 1.259s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:59 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd Jun 15 07:28:59 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:59 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:28:59 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:00 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd" returned: 0 in 0.819s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:29:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000fb733-a4b8-4b6e-8946-6dfb1d883dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec51206b-df39-4bf3-ab72-95ed866070cd', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8809e0e-8549-4ec4-b1df-95d4df806fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:00 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Volume volume-ec51206b-df39-4bf3-ab72-95ed866070cd (ec51206b-df39-4bf3-ab72-95ed866070cd): created successfully Jun 15 07:29:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8809e0e-8549-4ec4-b1df-95d4df806fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Flow 'volume_create_manager' (1854ad6f-d2a4-4a20-8699-7fbf48925ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:00 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-a9dc55dd-859c-4861-9283-92ea407ecc1d tempest-VolumesSnapshotTestJSON-1272434108 None] Created volume successfully. Jun 15 07:29:00 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.007s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:00 devstack cinder-volume[92129]: DEBUG cinder.manager [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:29:00 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Deleted volume successfully. Jun 15 07:29:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [req-5aef8016-1373-415e-a209-a1a808675bdc req-f57cd395-75d0-4d4b-9e06-2942cec5db79 tempest-TestShelveInstance-242574027 None] Lock "cinder-31d12f77-e0d2-4639-92ca-87a15b00f73a-delete_volume" released by "delete_volume" :: held 5.690s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:01 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] Creating offline snapshot b43785b7-d99d-482b-833c-ba0d2ac8330c of volume ec51206b-df39-4bf3-ab72-95ed866070cd {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:29:01 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fcf623-f280-4ca5-a3f4-a4924bb47c6c]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:01 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd Jun 15 07:29:01 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:02 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd" returned: 0 in 1.014s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:02 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c 1G Jun 15 07:29:02 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:03 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c 1G" returned: 0 in 1.102s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec51206b-df39-4bf3-ab72-95ed866070cd -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:03 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec51206b-df39-4bf3-ab72-95ed866070cd -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c Jun 15 07:29:03 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-863badb4-f592-450e-a098-b65eb7185673 tempest-VolumesActionsTest-329621901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:04 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec51206b-df39-4bf3-ab72-95ed866070cd -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c" returned: 0 in 0.807s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:04 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c is being set with open permissions: ugo+rw Jun 15 07:29:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:04 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c Jun 15 07:29:04 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:05 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c" returned: 0 in 0.647s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:05 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.info Jun 15 07:29:05 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:06 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.info" returned: 0 in 0.643s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:06 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.info is being set with open permissions: ugo+rw Jun 15 07:29:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:06 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.info Jun 15 07:29:06 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:06 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.info" returned: 0 in 0.619s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.942s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-863badb4-f592-450e-a098-b65eb7185673 tempest-VolumesActionsTest-329621901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.072s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:06 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3787dd-f33c-425e-8d9f-33b44bff0510]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-863badb4-f592-450e-a098-b65eb7185673 tempest-VolumesActionsTest-329621901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:06 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-9d8121f7-7181-4eef-b48a-1bb26be8c78d tempest-VolumesSnapshotTestJSON-1272434108 None] Create snapshot completed successfully Jun 15 07:29:06 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac Jun 15 07:29:06 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:07 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Flow 'volume_create_manager' (830c690b-febb-4dac-b0a3-7696dd2c9719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4c1749-62cc-4ac6-ac06-bf1047118ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4c1749-62cc-4ac6-ac06-bf1047118ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1297416233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077cdf53-6772-4ddb-ba58-6e33f2580f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3bb45e4a47434c9b6ebffb32f9f48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b43785b7-d99d-482b-833c-ba0d2ac8330c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:07Z,use_quota=True,user_id='d886bd87bc664383a332813e5147ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524af512-18b4-4b0a-8b3c-129fc330ee44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524af512-18b4-4b0a-8b3c-129fc330ee44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c25d77-dd8d-4f60-98a6-bffc15edca99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c25d77-dd8d-4f60-98a6-bffc15edca99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '077cdf53-6772-4ddb-ba58-6e33f2580f97', 'volume_name': 'volume-077cdf53-6772-4ddb-ba58-6e33f2580f97', 'volume_size': 2, 'snapshot_id': 'b43785b7-d99d-482b-833c-ba0d2ac8330c'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e86422-16c5-474f-89c0-b0a56a731897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e86422-16c5-474f-89c0-b0a56a731897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (022281b2-ef3e-4290-a794-af3467d0dced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:07 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Volume 077cdf53-6772-4ddb-ba58-6e33f2580f97: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-077cdf53-6772-4ddb-ba58-6e33f2580f97', 'volume_size': 2, 'snapshot_id': 'b43785b7-d99d-482b-833c-ba0d2ac8330c'} Jun 15 07:29:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:07 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-863badb4-f592-450e-a098-b65eb7185673 tempest-VolumesActionsTest-329621901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac" returned: 0 in 0.866s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:07 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[281eba34-2b8d-4d23-99cb-2616e655724b]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-863badb4-f592-450e-a098-b65eb7185673 tempest-VolumesActionsTest-329621901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:07 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac Jun 15 07:29:07 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:08 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-863badb4-f592-450e-a098-b65eb7185673 tempest-VolumesActionsTest-329621901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac" returned: 0 in 0.769s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-863badb4-f592-450e-a098-b65eb7185673 tempest-VolumesActionsTest-329621901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.e8e27fcc-f7be-445e-9c85-4c3e73bfb6631q1omqcd.img {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:08 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.e8e27fcc-f7be-445e-9c85-4c3e73bfb6631q1omqcd.img Jun 15 07:29:08 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:29:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:14 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:29:14 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:14 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-863badb4-f592-450e-a098-b65eb7185673 tempest-VolumesActionsTest-329621901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.e8e27fcc-f7be-445e-9c85-4c3e73bfb6631q1omqcd.img" returned: 0 in 5.695s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:14 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f1c43a-64d0-4b9f-ad67-7545dfcd3469]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-863badb4-f592-450e-a098-b65eb7185673 tempest-VolumesActionsTest-329621901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:14 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac Jun 15 07:29:14 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:14 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.694s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:14 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:29:14 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:29:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 28 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:29:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:29:15 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-863badb4-f592-450e-a098-b65eb7185673 tempest-VolumesActionsTest-329621901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac" returned: 0 in 0.935s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:15 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-863badb4-f592-450e-a098-b65eb7185673 tempest-VolumesActionsTest-329621901 None] Image conversion details: src /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.e8e27fcc-f7be-445e-9c85-4c3e73bfb6631q1omqcd.img {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:29:15 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-863badb4-f592-450e-a098-b65eb7185673 tempest-VolumesActionsTest-329621901 None] Converted 1024.00 MB image at 179.76 MB/s Jun 15 07:29:15 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-863badb4-f592-450e-a098-b65eb7185673 tempest-VolumesActionsTest-329621901 None] e8e27fcc-f7be-445e-9c85-4c3e73bfb663 was raw, no need to convert to raw {{(pid=92129) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 15 07:29:17 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:UPDATE=30,cinder:INSERT=7,cinder:SELECT=34,cinder:DELETE=3 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:29:18 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Flow 'volume_create_manager' (edde6a8a-b567-4696-862b-0eff2c9a12b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed5e8a3-97e1-441a-b32d-62e97e079309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed5e8a3-97e1-441a-b32d-62e97e079309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cbc0fe524a486aaa10b4a437f3bd92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:18Z,use_quota=True,user_id='78c00cc89bee4440b1f09db10ed77406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b6bd315-19f3-4ec1-9be1-2a3ed9c9fc39),volume_type_id=0b6bd315-19f3-4ec1-9be1-2a3ed9c9fc39)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f876afd8-e1d8-4c7d-a90e-e48adef89828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f876afd8-e1d8-4c7d-a90e-e48adef89828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a260088-bf4f-4587-be8d-b749e936b960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:18 devstack cinder-volume[92129]: DEBUG cinder.image.glance [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Creating Keystone auth plugin from conf {{(pid=92129) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:29:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a260088-bf4f-4587-be8d-b749e936b960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0', 'volume_name': 'volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0', 'volume_size': 1, 'image_id': '63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e734384014201c8029f9f86d88d2d22', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '31cbc0fe524a486aaa10b4a437f3bd92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '81aaf306307b4805cd66bf2ff1869ff79111f3e62767a41dcc88209e9a76b3d3afd4938b71b7a301ddd1d7b34909de394ba3bad60ee99cf641e50a767e4459ba', 'id': '63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c', 'created_at': datetime.datetime(2026, 6, 15, 5, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 29, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6e2552-9307-4cfe-9a0f-1abf16d23666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6e2552-9307-4cfe-9a0f-1abf16d23666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb9cea6-ee4e-41b4-859a-2e7be1d14114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:18 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Volume d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0', 'volume_size': 1, 'image_id': '63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e734384014201c8029f9f86d88d2d22', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '31cbc0fe524a486aaa10b4a437f3bd92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '81aaf306307b4805cd66bf2ff1869ff79111f3e62767a41dcc88209e9a76b3d3afd4938b71b7a301ddd1d7b34909de394ba3bad60ee99cf641e50a767e4459ba', 'id': '63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c', 'created_at': datetime.datetime(2026, 6, 15, 5, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 29, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 15 07:29:18 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Trying to clone d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 from image 63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c at location (None, [{'url': 'file:///opt/stack/data/glance/images/63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c', 'metadata': {}}]). {{(pid=92129) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:29:18 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:29:18 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Image download 0.00 MB at 0.00 MB/s Jun 15 07:29:18 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9f902d-a551-45b3-b5da-02ec254ac985]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-957cebc5-5350-45e0-bab1-d3c8d1c97624 req-af353c11-41c8-4250-b081-3ebe66051d1d tempest-TestServerVolumeAttachmentScenario-699393607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:18 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD Jun 15 07:29:18 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:19 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD" returned: 0 in 0.730s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:19 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD Jun 15 07:29:19 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:20 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD" returned: 1 in 0.687s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:29:20 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Temporary image 63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c is fetched for user 78c00cc89bee4440b1f09db10ed77406. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:29:20 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61f20fb-64ca-4fac-a309-e02b19d03c49]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:20 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD Jun 15 07:29:20 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:20 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD" returned: 0 in 0.751s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:21 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD Jun 15 07:29:21 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:21 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD" returned: 1 in 0.730s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:29:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:30 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=50,cinder:UPDATE=31,cinder:INSERT=9,cinder:DELETE=4 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:29:30 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2,cinder:INSERT=1 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-863badb4-f592-450e-a098-b65eb7185673 tempest-VolumesActionsTest-329621901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.486s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-863badb4-f592-450e-a098-b65eb7185673 tempest-VolumesActionsTest-329621901 None] Uploaded volume to glance image-id: e8e27fcc-f7be-445e-9c85-4c3e73bfb663. {{(pid=92129) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 26.539s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-quobyte-b43785b7-d99d-482b-833c-ba0d2ac8330c-077cdf53-6772-4ddb-ba58-6e33f2580f97" by "_create_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:34 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-863badb4-f592-450e-a098-b65eb7185673 tempest-VolumesActionsTest-329621901 None] Copy volume to image completed successfully. Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-b43785b7-d99d-482b-833c-ba0d2ac8330c-077cdf53-6772-4ddb-ba58-6e33f2580f97" acquired by "_create_volume_from_snapshot" :: waited 0.059s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Creating volume 077cdf53-6772-4ddb-ba58-6e33f2580f97 from snapshot b43785b7-d99d-482b-833c-ba0d2ac8330c {{(pid=92129) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-quobyte-077cdf53-6772-4ddb-ba58-6e33f2580f97" by "_copy_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-077cdf53-6772-4ddb-ba58-6e33f2580f97" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] snapshot: b43785b7-d99d-482b-833c-ba0d2ac8330c, volume: 077cdf53-6772-4ddb-ba58-6e33f2580f97, {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[723a17a4-e742-464b-9efa-71d5c091b652]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:34 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c Jun 15 07:29:34 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:35 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c" returned: 0 in 0.810s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:35 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec51206b-df39-4bf3-ab72-95ed866070cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:29:35 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:29:35 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Creating direct copy from snapshot {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:29:35 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[32938ea5-d7c9-430b-b67d-4b77104ad3dc]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:35 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd Jun 15 07:29:35 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:35 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd" returned: 0 in 0.728s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:35 devstack cinder-volume[92129]: DEBUG cinder.utils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Path /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-077cdf53-6772-4ddb-ba58-6e33f2580f97 not found in is_blk_device check {{(pid=92129) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:29:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-077cdf53-6772-4ddb-ba58-6e33f2580f97 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:35 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-077cdf53-6772-4ddb-ba58-6e33f2580f97 Jun 15 07:29:35 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:40 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-077cdf53-6772-4ddb-ba58-6e33f2580f97" returned: 0 in 4.460s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:40 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2066e6e5-e947-4aa2-88d2-9b4d03274ab7]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:40 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd Jun 15 07:29:40 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:41 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd" returned: 0 in 0.903s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:41 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Image conversion details: src /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd, size 1024.00 MB, duration 4.46 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-077cdf53-6772-4ddb-ba58-6e33f2580f97 {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:29:41 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Converted 1024.00 MB image at 229.52 MB/s Jun 15 07:29:41 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-077cdf53-6772-4ddb-ba58-6e33f2580f97 is being set with open permissions: ugo+rw Jun 15 07:29:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-077cdf53-6772-4ddb-ba58-6e33f2580f97 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:41 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-077cdf53-6772-4ddb-ba58-6e33f2580f97 Jun 15 07:29:41 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:41 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-077cdf53-6772-4ddb-ba58-6e33f2580f97" returned: 0 in 0.570s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-077cdf53-6772-4ddb-ba58-6e33f2580f97" released by "_copy_volume_from_snapshot" :: held 7.567s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-b43785b7-d99d-482b-833c-ba0d2ac8330c-077cdf53-6772-4ddb-ba58-6e33f2580f97" released by "_create_volume_from_snapshot" :: held 7.593s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.654s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-957cebc5-5350-45e0-bab1-d3c8d1c97624 req-af353c11-41c8-4250-b081-3ebe66051d1d tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 23.021s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:41 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9e8f8e-effb-49d6-8b5c-97a3d4eae614]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-957cebc5-5350-45e0-bab1-d3c8d1c97624 req-af353c11-41c8-4250-b081-3ebe66051d1d tempest-TestServerVolumeAttachmentScenario-699393607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-becf5b11-f584-4087-a0fe-4480a2973c7d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (022281b2-ef3e-4290-a794-af3467d0dced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-077cdf53-6772-4ddb-ba58-6e33f2580f97', 'volume_size': 2, 'snapshot_id': 'b43785b7-d99d-482b-833c-ba0d2ac8330c'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ad4438-c4c2-4593-8bce-04ba7b74884c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:41 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Volume volume-077cdf53-6772-4ddb-ba58-6e33f2580f97 (077cdf53-6772-4ddb-ba58-6e33f2580f97): created successfully Jun 15 07:29:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ad4438-c4c2-4593-8bce-04ba7b74884c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Flow 'volume_create_manager' (830c690b-febb-4dac-b0a3-7696dd2c9719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:41 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-a4ce87c9-ce56-4509-9c26-16b55c8c436e tempest-VolumesSnapshotTestJSON-1272434108 None] Created volume successfully. Jun 15 07:29:41 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-becf5b11-f584-4087-a0fe-4480a2973c7d Jun 15 07:29:41 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:42 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-957cebc5-5350-45e0-bab1-d3c8d1c97624 req-af353c11-41c8-4250-b081-3ebe66051d1d tempest-TestServerVolumeAttachmentScenario-699393607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-becf5b11-f584-4087-a0fe-4480a2973c7d" returned: 0 in 0.702s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-957cebc5-5350-45e0-bab1-d3c8d1c97624 req-af353c11-41c8-4250-b081-3ebe66051d1d tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.723s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.873s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cbc0fe524a486aaa10b4a437f3bd92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:18Z,use_quota=True,user_id='78c00cc89bee4440b1f09db10ed77406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b6bd315-19f3-4ec1-9be1-2a3ed9c9fc39),volume_type_id=0b6bd315-19f3-4ec1-9be1-2a3ed9c9fc39)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Creating volume d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:42 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:42 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 1073741824 Jun 15 07:29:42 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-957cebc5-5350-45e0-bab1-d3c8d1c97624 req-af353c11-41c8-4250-b081-3ebe66051d1d tempest-TestServerVolumeAttachmentScenario-699393607 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-becf5b11-f584-4087-a0fe-4480a2973c7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20401086-f290-4d91-aa90-e01c2bee8547', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:29:42 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-957cebc5-5350-45e0-bab1-d3c8d1c97624 req-af353c11-41c8-4250-b081-3ebe66051d1d tempest-TestServerVolumeAttachmentScenario-699393607 None] attachment_update completed successfully. Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-077cdf53-6772-4ddb-ba58-6e33f2580f97-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-077cdf53-6772-4ddb-ba58-6e33f2580f97-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-quobyte-077cdf53-6772-4ddb-ba58-6e33f2580f97" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-077cdf53-6772-4ddb-ba58-6e33f2580f97" acquired by "delete_volume" :: waited 0.020s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba73e350-5d91-4072-96fa-2c33e41c25bf]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-077cdf53-6772-4ddb-ba58-6e33f2580f97 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:43 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-077cdf53-6772-4ddb-ba58-6e33f2580f97 Jun 15 07:29:43 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:43 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 1073741824" returned: 0 in 0.847s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:43 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 Jun 15 07:29:43 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:43 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-077cdf53-6772-4ddb-ba58-6e33f2580f97" returned: 0 in 0.803s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-077cdf53-6772-4ddb-ba58-6e33f2580f97 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:43 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-077cdf53-6772-4ddb-ba58-6e33f2580f97 Jun 15 07:29:43 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:44 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0" returned: 0 in 0.697s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 8.256s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[30142ae6-e290-4fc2-9047-b582f3b30f4e]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Attempting download of 63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c ((None, [{'url': 'file:///opt/stack/data/glance/images/63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c', 'metadata': {}}])) to volume d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a474b7-0c33-4908-839d-325b80a0ed0f]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_4giz1wvl {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:44 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac Jun 15 07:29:44 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:44 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_4giz1wvl Jun 15 07:29:44 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:44 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-077cdf53-6772-4ddb-ba58-6e33f2580f97" returned: 0 in 0.660s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-077cdf53-6772-4ddb-ba58-6e33f2580f97" released by "delete_volume" :: held 1.517s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] Created reservations ['a9d56564-b533-433b-a776-3e57f954c27a', '7c3d9b43-2d58-4d0f-836e-0f03df275561', '833f5324-bc46-478e-9686-f1289e09ee7e', '51b20ddd-0bf0-4f9d-a997-992bc03a1b0c'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:44 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:29:44 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:44 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac" returned: 0 in 0.778s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd42b1e-0b8a-421c-9360-03528d1d5180]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:45 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_4giz1wvl" returned: 0 in 0.762s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_4giz1wvl {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:45 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac Jun 15 07:29:45 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:45 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_4giz1wvl Jun 15 07:29:45 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-b43785b7-d99d-482b-833c-ba0d2ac8330c-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:45 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.692s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-b43785b7-d99d-482b-833c-ba0d2ac8330c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-quobyte-ec51206b-df39-4bf3-ab72-95ed866070cd" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:45 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] Deleted volume successfully. Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-ec51206b-df39-4bf3-ab72-95ed866070cd" acquired by "delete_snapshot" :: waited 0.037s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-quobyte-b43785b7-d99d-482b-833c-ba0d2ac8330c" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cbe58951-f657-49aa-b657-e7977ef53d42 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-077cdf53-6772-4ddb-ba58-6e33f2580f97-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-b43785b7-d99d-482b-833c-ba0d2ac8330c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] Deleting offline snapshot b43785b7-d99d-482b-833c-ba0d2ac8330c of volume ec51206b-df39-4bf3-ab72-95ed866070cd {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] snapshot_file for this snap is: volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd67fc9-28ab-4a41-ad00-7b722b747694]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:45 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c Jun 15 07:29:45 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:45 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_4giz1wvl" returned: 1 in 0.777s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_4giz1wvl' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e95eff9-a227-460e-9070-d6bd62fd2c81]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:45 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac" returned: 0 in 0.827s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.bc41c72a-d87a-4589-a69e-1ec926218b4f6x1v8au5.img {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:45 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.bc41c72a-d87a-4589-a69e-1ec926218b4f6x1v8au5.img Jun 15 07:29:45 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:45 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD Jun 15 07:29:45 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:46 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c" returned: 0 in 0.794s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:46 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec51206b-df39-4bf3-ab72-95ed866070cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:29:46 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[57442a87-63b9-4998-b4e5-56c8dc373814]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:46 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd Jun 15 07:29:46 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:46 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD" returned: 0 in 0.925s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:46 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD Jun 15 07:29:46 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:47 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd" returned: 0 in 1.633s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:47 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c Jun 15 07:29:47 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:48 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD" returned: 1 in 1.852s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:29:48 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] 63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c was raw, converting to raw {{(pid=92129) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:29:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:48 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 Jun 15 07:29:48 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:49 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c" returned: 0 in 1.994s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:49 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c Jun 15 07:29:49 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:50 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0" returned: 0 in 2.025s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:50 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c_yhipags8devstack@QuobyteHD, size 0.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:29:50 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Converted 0.00 MB image at 0.00 MB/s Jun 15 07:29:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:50 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 1G Jun 15 07:29:50 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:51 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd.b43785b7-d99d-482b-833c-ba0d2ac8330c" returned: 0 in 1.685s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-b43785b7-d99d-482b-833c-ba0d2ac8330c" released by "_delete_snapshot" :: held 6.301s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-ec51206b-df39-4bf3-ab72-95ed866070cd" released by "delete_snapshot" :: held 6.337s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:51 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] Created reservations ['59b3da44-8f05-4ab2-9e70-3d398727bd70', '38460b56-ce0a-49d5-9a19-3a592ec62b17', '8e3bba6a-eb0c-4c2b-b749-aff6e1e28771', '99827ab2-2bad-4f1b-ada9-37c6855ac175'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:51 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] Delete snapshot completed successfully. Jun 15 07:29:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6c4ae511-b445-47b1-92d2-c59cac92b58a tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-b43785b7-d99d-482b-833c-ba0d2ac8330c-delete_snapshot" released by "delete_snapshot" :: held 6.551s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:51 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.bc41c72a-d87a-4589-a69e-1ec926218b4f6x1v8au5.img" returned: 0 in 6.010s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:51 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99e1c29-23fa-4fdf-8636-5090c9fef624]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:51 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 1G" returned: 0 in 1.331s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:51 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac Jun 15 07:29:51 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:52 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a86649-b0ff-4710-b182-8c3f0aa72996]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-ec51206b-df39-4bf3-ab72-95ed866070cd-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-ec51206b-df39-4bf3-ab72-95ed866070cd-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-quobyte-ec51206b-df39-4bf3-ab72-95ed866070cd" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-ec51206b-df39-4bf3-ab72-95ed866070cd" acquired by "delete_volume" :: waited 0.021s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:52 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 Jun 15 07:29:52 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:52 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8a201d-2667-465f-bde2-0e7a28bf914d]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:52 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd Jun 15 07:29:52 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:52 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac" returned: 0 in 1.063s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:52 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] Image conversion details: src /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.bc41c72a-d87a-4589-a69e-1ec926218b4f6x1v8au5.img {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:29:52 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] Converted 1024.00 MB image at 170.37 MB/s Jun 15 07:29:52 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] bc41c72a-d87a-4589-a69e-1ec926218b4f was raw, converting to qcow2 {{(pid=92129) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 15 07:29:52 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:52 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d7c981-87f9-44c1-a445-47e763cefca7]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.bc41c72a-d87a-4589-a69e-1ec926218b4f6x1v8au5.img {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0" returned: 0 in 0.968s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:53 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.bc41c72a-d87a-4589-a69e-1ec926218b4f6x1v8au5.img Jun 15 07:29:53 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:53 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd" returned: 0 in 0.880s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:53 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 Jun 15 07:29:53 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:53 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd Jun 15 07:29:53 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:53 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ec51206b-df39-4bf3-ab72-95ed866070cd" returned: 0 in 0.659s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:53 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.bc41c72a-d87a-4589-a69e-1ec926218b4f6x1v8au5.img" returned: 0 in 0.849s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.bc41c72a-d87a-4589-a69e-1ec926218b4f6x1v8au5.img {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:53 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-ec51206b-df39-4bf3-ab72-95ed866070cd" released by "delete_volume" :: held 1.651s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:53 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0" returned: 1 in 0.879s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:29:53 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Downloaded image 63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c ((None, [{'url': 'file:///opt/stack/data/glance/images/63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c', 'metadata': {}}])) to volume d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 successfully. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:29:53 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Temporary image 63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c for user 78c00cc89bee4440b1f09db10ed77406 is deleted. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:29:53 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Marking volume d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 as bootable. {{(pid=92129) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:29:53 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.bc41c72a-d87a-4589-a69e-1ec926218b4f6x1v8au5.img Jun 15 07:29:53 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:54 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Copying metadata from image 63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c to d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0. {{(pid=92129) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:29:54 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Creating volume glance metadata for volume d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 backed by image 63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7e734384014201c8029f9f86d88d2d22', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92129) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:29:54 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] Created reservations ['f8b6c7b9-cb89-4809-ac93-802f064c295a', 'd46668ba-1416-43ba-b7b5-18b9abde6036', '85941264-bfc6-4e0b-a559-3b0d966fff1d', '2609c00a-c510-4318-9bb5-a67544190cf5'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb9cea6-ee4e-41b4-859a-2e7be1d14114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0', 'volume_size': 1, 'image_id': '63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e734384014201c8029f9f86d88d2d22', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '31cbc0fe524a486aaa10b4a437f3bd92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '81aaf306307b4805cd66bf2ff1869ff79111f3e62767a41dcc88209e9a76b3d3afd4938b71b7a301ddd1d7b34909de394ba3bad60ee99cf641e50a767e4459ba', 'id': '63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c', 'created_at': datetime.datetime(2026, 6, 15, 5, 29, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 29, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63e6d8e9-18e2-4efe-88c1-7f1d0a08f10c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbcf7ce-2673-4d99-b758-1f1f39a34265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:54 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Volume volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 (d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0): created successfully Jun 15 07:29:54 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:29:54 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbcf7ce-2673-4d99-b758-1f1f39a34265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Flow 'volume_create_manager' (edde6a8a-b567-4696-862b-0eff2c9a12b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:54 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-60ba508c-d431-483d-b726-d5efd831f0c2 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Created volume successfully. Jun 15 07:29:54 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.bc41c72a-d87a-4589-a69e-1ec926218b4f6x1v8au5.img" returned: 1 in 0.831s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.bc41c72a-d87a-4589-a69e-1ec926218b4f6x1v8au5.img' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:29:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.bc41c72a-d87a-4589-a69e-1ec926218b4f6x1v8au5.img /opt/stack/data/cinder/conversion/vol_upload_o8g8nnjl {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:54 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.bc41c72a-d87a-4589-a69e-1ec926218b4f6x1v8au5.img /opt/stack/data/cinder/conversion/vol_upload_o8g8nnjl Jun 15 07:29:54 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:55 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.640s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:55 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:29:55 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] Deleted volume successfully. Jun 15 07:29:55 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-920e68c1-e4ee-4031-970e-1afcf00d7aae tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-ec51206b-df39-4bf3-ab72-95ed866070cd-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:55 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Acquiring lock "cinder-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:55 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Lock "cinder-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:55 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.bc41c72a-d87a-4589-a69e-1ec926218b4f6x1v8au5.img /opt/stack/data/cinder/conversion/vol_upload_o8g8nnjl" returned: 0 in 0.661s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:55 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] Image conversion details: src /opt/stack/data/cinder/conversion/9e48f6a3-6b47-4431-b897-d045c28aabac.temp_image.bc41c72a-d87a-4589-a69e-1ec926218b4f6x1v8au5.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_o8g8nnjl {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:29:55 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 15 07:29:55 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77845d1-80be-48ed-9abf-6f8811f050ed]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o8g8nnjl {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:55 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Acquiring lock "cinder-quobyte-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:55 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Lock "cinder-quobyte-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0" acquired by "delete_volume" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:55 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d526acd3-8cfe-42de-a4ac-ff2ca378697f]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:55 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o8g8nnjl Jun 15 07:29:55 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:55 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 Jun 15 07:29:55 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:56 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Flow 'volume_create_manager' (03366369-ac7b-49f8-9427-b324aa683716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5238cdcb-cd15-4e8b-b1d9-6e82538f3adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5238cdcb-cd15-4e8b-b1d9-6e82538f3adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-353273446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c757319-2fea-4f54-a1cf-29918126da60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3bb45e4a47434c9b6ebffb32f9f48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:56Z,use_quota=True,user_id='d886bd87bc664383a332813e5147ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342dfdb9-6301-46fc-975e-c7f0439e0da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342dfdb9-6301-46fc-975e-c7f0439e0da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5475337a-78dd-4219-aeb6-58cd09dd5dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5475337a-78dd-4219-aeb6-58cd09dd5dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c757319-2fea-4f54-a1cf-29918126da60', 'volume_name': 'volume-4c757319-2fea-4f54-a1cf-29918126da60', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6aa41b1-c15e-4f53-b310-97d8d09f6e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:56 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6aa41b1-c15e-4f53-b310-97d8d09f6e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbeb0a25-35b0-499a-9ac6-73ede72104a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:56 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Volume 4c757319-2fea-4f54-a1cf-29918126da60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c757319-2fea-4f54-a1cf-29918126da60', 'volume_size': 1} Jun 15 07:29:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o8g8nnjl" returned: 0 in 0.876s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:56 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0" returned: 0 in 0.874s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:56 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 Jun 15 07:29:56 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-3bfc1c27-9e6d-4476-a6d4-fc5c595c7144 req-eb70a21b-1391-4b8e-b6c7-e93e70d9979f tempest-TestServerVolumeAttachmentScenario-699393607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:57 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0" returned: 1 in 0.792s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:57 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0 Jun 15 07:29:57 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:57 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0" returned: 0 in 0.699s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Lock "cinder-quobyte-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0" released by "delete_volume" :: held 2.442s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:57 devstack cinder-volume[92129]: WARNING cinder.quota [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:29:57 devstack cinder-volume[92129]: WARNING cinder.quota [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.687s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] Uploaded volume to glance image-id: bc41c72a-d87a-4589-a69e-1ec926218b4f. {{(pid=92129) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.657s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-353273446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c757319-2fea-4f54-a1cf-29918126da60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3bb45e4a47434c9b6ebffb32f9f48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:56Z,use_quota=True,user_id='d886bd87bc664383a332813e5147ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Creating volume 4c757319-2fea-4f54-a1cf-29918126da60 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:57 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:57 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 1073741824 Jun 15 07:29:57 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Created reservations ['d5a6cc8b-debf-4d51-a4f5-c4eefb0db41c', 'd282dce0-214d-498d-8cb9-3f6351b145c2', 'ef66d7cf-6e49-4885-96d9-87f684cc4f06', '3b9cfa61-5fe9-4587-b945-c068e7004b2b'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:57 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-b813f38c-1a09-4b77-899c-5f14c903a994 tempest-VolumesActionsTest-329621901 None] Copy volume to image completed successfully. Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:57 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:29:57 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:58 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.731s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:58 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:29:58 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Deleted volume successfully. Jun 15 07:29:58 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:58 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f3881ce4-0a37-4308-ac75-01421cf9f350 tempest-VolumeAndVolumeTypeFromImageTest-1156990691 None] Lock "cinder-d1ab35fb-0d7a-44a5-8b35-1e4b1ca6c5b0-delete_volume" released by "delete_volume" :: held 3.472s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 1073741824" returned: 0 in 0.906s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:58 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 Jun 15 07:29:58 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:58 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] Acquiring lock "cinder-9e48f6a3-6b47-4431-b897-d045c28aabac-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:58 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] Lock "cinder-9e48f6a3-6b47-4431-b897-d045c28aabac-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:59 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] Acquiring lock "cinder-quobyte-9e48f6a3-6b47-4431-b897-d045c28aabac" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:59 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] Lock "cinder-quobyte-9e48f6a3-6b47-4431-b897-d045c28aabac" acquired by "delete_volume" :: waited 0.018s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:59 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34397e7-5bc8-4d3e-b27b-dcb8997b17bc]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:59 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac Jun 15 07:29:59 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:59 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60" returned: 0 in 0.727s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:29:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-3bfc1c27-9e6d-4476-a6d4-fc5c595c7144 req-eb70a21b-1391-4b8e-b6c7-e93e70d9979f tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.946s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbeb0a25-35b0-499a-9ac6-73ede72104a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c757319-2fea-4f54-a1cf-29918126da60', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08e658b-0815-42a0-a4a5-6a3d79462c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:59 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f8ae90-81dc-4d0a-a599-7f67cf1e8891]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-3bfc1c27-9e6d-4476-a6d4-fc5c595c7144 req-eb70a21b-1391-4b8e-b6c7-e93e70d9979f tempest-TestServerVolumeAttachmentScenario-699393607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:59 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Volume volume-4c757319-2fea-4f54-a1cf-29918126da60 (4c757319-2fea-4f54-a1cf-29918126da60): created successfully Jun 15 07:29:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08e658b-0815-42a0-a4a5-6a3d79462c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Flow 'volume_create_manager' (03366369-ac7b-49f8-9427-b324aa683716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:59 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-ebae2690-d33a-4975-8937-81d18a08115f tempest-VolumesSnapshotTestJSON-1272434108 None] Created volume successfully. Jun 15 07:29:59 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8 Jun 15 07:29:59 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:59 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac" returned: 0 in 0.791s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:59 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac Jun 15 07:29:59 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:00 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-3bfc1c27-9e6d-4476-a6d4-fc5c595c7144 req-eb70a21b-1391-4b8e-b6c7-e93e70d9979f tempest-TestServerVolumeAttachmentScenario-699393607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8" returned: 0 in 0.928s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-3bfc1c27-9e6d-4476-a6d4-fc5c595c7144 req-eb70a21b-1391-4b8e-b6c7-e93e70d9979f tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.979s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-3bfc1c27-9e6d-4476-a6d4-fc5c595c7144 req-eb70a21b-1391-4b8e-b6c7-e93e70d9979f tempest-TestServerVolumeAttachmentScenario-699393607 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e13ba02a-5c97-4d67-a104-a34a5c8a8bbc', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:30:00 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-9e48f6a3-6b47-4431-b897-d045c28aabac" returned: 0 in 0.745s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] Lock "cinder-quobyte-9e48f6a3-6b47-4431-b897-d045c28aabac" released by "delete_volume" :: held 1.628s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:00 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-3bfc1c27-9e6d-4476-a6d4-fc5c595c7144 req-eb70a21b-1391-4b8e-b6c7-e93e70d9979f tempest-TestServerVolumeAttachmentScenario-699393607 None] attachment_update completed successfully. Jun 15 07:30:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] Creating offline snapshot 6f2d257a-1199-4798-80e4-bc986494b206 of volume 4c757319-2fea-4f54-a1cf-29918126da60 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:30:00 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6790c6ae-d28d-431e-8c0a-6d27f6b9c590]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:00 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] Created reservations ['100aee5d-800b-4ddd-99e0-ca4aac1f004a', '7d2b2843-40b1-4473-8998-c077a9bfc59d', '3fec4c22-5de5-49e2-a57c-86507fbe05ed', 'f294a31f-1de9-4d8a-a208-5811e9a54dd4'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:00 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 Jun 15 07:30:00 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:00 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:30:00 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:01 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.739s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:01 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:01 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] Deleted volume successfully. Jun 15 07:30:01 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-95850938-d780-4ace-beb3-06e09205e716 tempest-VolumesActionsTest-329621901 None] Lock "cinder-9e48f6a3-6b47-4431-b897-d045c28aabac-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:01 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60" returned: 0 in 0.928s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:01 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206 1G Jun 15 07:30:01 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:02 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206 1G" returned: 0 in 0.965s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c757319-2fea-4f54-a1cf-29918126da60 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:02 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c757319-2fea-4f54-a1cf-29918126da60 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206 Jun 15 07:30:02 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:03 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c757319-2fea-4f54-a1cf-29918126da60 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206" returned: 0 in 0.779s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:03 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206 is being set with open permissions: ugo+rw Jun 15 07:30:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:03 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206 Jun 15 07:30:03 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:04 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Flow 'volume_create_manager' (cb7927ab-3ef3-4940-9e6c-2366d41736fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def55b5f-391f-4e9b-a61a-f5a2548d6c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def55b5f-391f-4e9b-a61a-f5a2548d6c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1064229024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b81778-b622-4892-86b0-ced1d1a3a737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f2a9966424d95a99984b5877b7bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:04Z,use_quota=True,user_id='e543f20d53b944d9af2f5c6c3d28abcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9209f3f-2821-4e77-9dc8-2330a442e102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9209f3f-2821-4e77-9dc8-2330a442e102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024467e6-5490-45ab-b7c6-4b16bf96a3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024467e6-5490-45ab-b7c6-4b16bf96a3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5b81778-b622-4892-86b0-ced1d1a3a737', 'volume_name': 'volume-f5b81778-b622-4892-86b0-ced1d1a3a737', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9dfc088-a86a-4f1a-b51f-91b8083430af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9dfc088-a86a-4f1a-b51f-91b8083430af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:04 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4067ede0-ddc1-4215-a6bd-f328cd20df24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:04 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume f5b81778-b622-4892-86b0-ced1d1a3a737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5b81778-b622-4892-86b0-ced1d1a3a737', 'volume_size': 1} Jun 15 07:30:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206" returned: 0 in 0.741s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:04 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.info Jun 15 07:30:04 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:04 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.info" returned: 0 in 0.669s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:04 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.info is being set with open permissions: ugo+rw Jun 15 07:30:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:04 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.info Jun 15 07:30:04 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:05 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.info" returned: 0 in 0.712s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.893s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.443s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1064229024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b81778-b622-4892-86b0-ced1d1a3a737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f2a9966424d95a99984b5877b7bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:04Z,use_quota=True,user_id='e543f20d53b944d9af2f5c6c3d28abcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Creating volume f5b81778-b622-4892-86b0-ced1d1a3a737 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:05 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:30:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:05 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737 1073741824 Jun 15 07:30:05 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:05 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-6f960c54-55fe-4bd0-a98b-461d37087a27 tempest-VolumesSnapshotTestJSON-1272434108 None] Create snapshot completed successfully Jun 15 07:30:06 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737 1073741824" returned: 0 in 0.930s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:06 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Flow 'volume_create_manager' (cafc6972-a105-4042-9a72-830ec069d18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76afecbe-8379-4d97-80ee-1782ffb0663f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76afecbe-8379-4d97-80ee-1782ffb0663f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2106820634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1148b3df-1964-44fd-885b-15dc6ef00780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3bb45e4a47434c9b6ebffb32f9f48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6f2d257a-1199-4798-80e4-bc986494b206,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:07Z,use_quota=True,user_id='d886bd87bc664383a332813e5147ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e048b576-2205-4a0e-b3f7-a93177a912fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:06 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737 Jun 15 07:30:06 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e048b576-2205-4a0e-b3f7-a93177a912fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720cda45-ab1b-48b6-8731-fe5ac555b1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720cda45-ab1b-48b6-8731-fe5ac555b1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1148b3df-1964-44fd-885b-15dc6ef00780', 'volume_name': 'volume-1148b3df-1964-44fd-885b-15dc6ef00780', 'volume_size': 1, 'snapshot_id': '6f2d257a-1199-4798-80e4-bc986494b206'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c1371b-fd6a-49fb-857f-3a885ddfcd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c1371b-fd6a-49fb-857f-3a885ddfcd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320c21f6-dff8-435f-9e3f-cd2ece8fe3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:06 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Volume 1148b3df-1964-44fd-885b-15dc6ef00780: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1148b3df-1964-44fd-885b-15dc6ef00780', 'volume_size': 1, 'snapshot_id': '6f2d257a-1199-4798-80e4-bc986494b206'} Jun 15 07:30:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:07 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-688104da-3892-44d5-83a8-cf7ab972456c req-9fb6c3a0-ed4a-4d62-b8dd-d821c515f9ab tempest-TestServerVolumeAttachmentScenario-699393607 None] Terminate volume connection completed successfully. Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-688104da-3892-44d5-83a8-cf7ab972456c req-9fb6c3a0-ed4a-4d62-b8dd-d821c515f9ab tempest-TestServerVolumeAttachmentScenario-699393607 None] Deleting attachment e13ba02a-5c97-4d67-a104-a34a5c8a8bbc. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:30:07 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737" returned: 0 in 0.664s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.581s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-quobyte-6f2d257a-1199-4798-80e4-bc986494b206-1148b3df-1964-44fd-885b-15dc6ef00780" by "_create_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4067ede0-ddc1-4215-a6bd-f328cd20df24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5b81778-b622-4892-86b0-ced1d1a3a737', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1703e35-dc2e-4f12-bbf6-070709bdc963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-6f2d257a-1199-4798-80e4-bc986494b206-1148b3df-1964-44fd-885b-15dc6ef00780" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Creating volume 1148b3df-1964-44fd-885b-15dc6ef00780 from snapshot 6f2d257a-1199-4798-80e4-bc986494b206 {{(pid=92129) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-quobyte-1148b3df-1964-44fd-885b-15dc6ef00780" by "_copy_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:07 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume volume-f5b81778-b622-4892-86b0-ced1d1a3a737 (f5b81778-b622-4892-86b0-ced1d1a3a737): created successfully Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1703e35-dc2e-4f12-bbf6-070709bdc963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Flow 'volume_create_manager' (cb7927ab-3ef3-4940-9e6c-2366d41736fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-1148b3df-1964-44fd-885b-15dc6ef00780" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] snapshot: 6f2d257a-1199-4798-80e4-bc986494b206, volume: 1148b3df-1964-44fd-885b-15dc6ef00780, {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:30:07 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-6b5fe492-2adb-4d61-90cd-531074164288 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Created volume successfully. Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6d26fc-9acb-418a-b2df-dffc3573fbce]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:07 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206 Jun 15 07:30:07 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:08 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206" returned: 0 in 0.757s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c757319-2fea-4f54-a1cf-29918126da60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:30:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:30:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Creating direct copy from snapshot {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:30:08 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4156c0-1ddb-4bac-abc0-6850d103c82b]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:08 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 Jun 15 07:30:08 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:09 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60" returned: 0 in 0.817s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:09 devstack cinder-volume[92129]: DEBUG cinder.utils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Path /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1148b3df-1964-44fd-885b-15dc6ef00780 not found in is_blk_device check {{(pid=92129) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:30:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1148b3df-1964-44fd-885b-15dc6ef00780 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:09 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1148b3df-1964-44fd-885b-15dc6ef00780 Jun 15 07:30:09 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:11 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-d0e4bea2-6266-412d-aac9-18ce1eeb63fa req-311c6c12-6274-4f13-8d0c-27f467b6a307 tempest-TestServerVolumeAttachmentScenario-699393607 None] Terminate volume connection completed successfully. Jun 15 07:30:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-d0e4bea2-6266-412d-aac9-18ce1eeb63fa req-311c6c12-6274-4f13-8d0c-27f467b6a307 tempest-TestServerVolumeAttachmentScenario-699393607 None] Deleting attachment 20401086-f290-4d91-aa90-e01c2bee8547. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:30:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:30:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:14 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:30:14 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:14 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1148b3df-1964-44fd-885b-15dc6ef00780" returned: 0 in 5.728s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:14 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c7e2b8-79da-4166-8c46-3a2e8661b921]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:14 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 Jun 15 07:30:14 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:14 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.999s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:14 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:14 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:30:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 28 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:30:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:30:15 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60" returned: 0 in 1.211s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:15 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Image conversion details: src /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1148b3df-1964-44fd-885b-15dc6ef00780 {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:30:15 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Converted 1024.00 MB image at 178.74 MB/s Jun 15 07:30:15 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1148b3df-1964-44fd-885b-15dc6ef00780 is being set with open permissions: ugo+rw Jun 15 07:30:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1148b3df-1964-44fd-885b-15dc6ef00780 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:16 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1148b3df-1964-44fd-885b-15dc6ef00780 Jun 15 07:30:16 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:16 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1148b3df-1964-44fd-885b-15dc6ef00780" returned: 0 in 0.642s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-1148b3df-1964-44fd-885b-15dc6ef00780" released by "_copy_volume_from_snapshot" :: held 9.276s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-6f2d257a-1199-4798-80e4-bc986494b206-1148b3df-1964-44fd-885b-15dc6ef00780" released by "_create_volume_from_snapshot" :: held 9.318s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.349s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.056s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Creating offline snapshot 44fb5f44-8c8f-4a11-881f-34c83c324629 of volume f5b81778-b622-4892-86b0-ced1d1a3a737 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:30:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320c21f6-dff8-435f-9e3f-cd2ece8fe3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1148b3df-1964-44fd-885b-15dc6ef00780', 'volume_size': 1, 'snapshot_id': '6f2d257a-1199-4798-80e4-bc986494b206'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e92df2-7459-4d8f-8fde-2c63cf50ec8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:16 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e6004d-fa29-4799-9a5e-06f8557fc88e]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:16 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Volume volume-1148b3df-1964-44fd-885b-15dc6ef00780 (1148b3df-1964-44fd-885b-15dc6ef00780): created successfully Jun 15 07:30:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e92df2-7459-4d8f-8fde-2c63cf50ec8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Flow 'volume_create_manager' (cafc6972-a105-4042-9a72-830ec069d18d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:16 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-11745503-add0-49a3-a3a4-9b987431959b tempest-VolumesSnapshotTestJSON-1272434108 None] Created volume successfully. Jun 15 07:30:16 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737 Jun 15 07:30:16 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:17 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737" returned: 0 in 0.999s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-1148b3df-1964-44fd-885b-15dc6ef00780-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:17 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629 1G Jun 15 07:30:17 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-1148b3df-1964-44fd-885b-15dc6ef00780-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-quobyte-1148b3df-1964-44fd-885b-15dc6ef00780" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-1148b3df-1964-44fd-885b-15dc6ef00780" acquired by "delete_volume" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:17 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af85128-9d7f-43f2-bd8d-f0408f0b1416]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1148b3df-1964-44fd-885b-15dc6ef00780 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:18 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1148b3df-1964-44fd-885b-15dc6ef00780 Jun 15 07:30:18 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:18 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629 1G" returned: 0 in 1.008s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5b81778-b622-4892-86b0-ced1d1a3a737 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:18 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5b81778-b622-4892-86b0-ced1d1a3a737 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629 Jun 15 07:30:18 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:18 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1148b3df-1964-44fd-885b-15dc6ef00780" returned: 0 in 0.902s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1148b3df-1964-44fd-885b-15dc6ef00780 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:18 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1148b3df-1964-44fd-885b-15dc6ef00780 Jun 15 07:30:18 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:19 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5b81778-b622-4892-86b0-ced1d1a3a737 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629" returned: 0 in 0.702s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:19 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629 is being set with open permissions: ugo+rw Jun 15 07:30:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:19 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1148b3df-1964-44fd-885b-15dc6ef00780" returned: 0 in 0.655s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:19 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629 Jun 15 07:30:19 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-1148b3df-1964-44fd-885b-15dc6ef00780" released by "delete_volume" :: held 1.615s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:19 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] Created reservations ['e960f1dc-77dc-417f-928e-c6654ea4350b', 'f68e19cf-6375-45f3-a6a7-119113d37cc0', '8a23b77f-6838-4fd0-8ca2-e991df99e273', '310ee9a4-c0ae-4027-b5b3-90ed84a84c25'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:19 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:30:19 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-6f2d257a-1199-4798-80e4-bc986494b206-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-6f2d257a-1199-4798-80e4-bc986494b206-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-quobyte-4c757319-2fea-4f54-a1cf-29918126da60" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-4c757319-2fea-4f54-a1cf-29918126da60" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-quobyte-6f2d257a-1199-4798-80e4-bc986494b206" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:20 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629" returned: 0 in 0.791s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-6f2d257a-1199-4798-80e4-bc986494b206" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] Deleting offline snapshot 6f2d257a-1199-4798-80e4-bc986494b206 of volume 4c757319-2fea-4f54-a1cf-29918126da60 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:30:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] snapshot_file for this snap is: volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:30:20 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04adb58-5e02-40ca-9fb1-192921da5beb]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:20 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.738s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:20 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:20 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] Deleted volume successfully. Jun 15 07:30:20 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.info Jun 15 07:30:20 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4aafdb21-5154-4882-9f48-765789183543 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-1148b3df-1964-44fd-885b-15dc6ef00780-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:20 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206 Jun 15 07:30:20 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:20 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.info" returned: 0 in 0.658s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:20 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.info is being set with open permissions: ugo+rw Jun 15 07:30:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:21 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.info Jun 15 07:30:21 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:21 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206" returned: 0 in 0.812s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c757319-2fea-4f54-a1cf-29918126da60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:30:21 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a8350b-81f2-49c5-89a6-b195c4a1871d]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:21 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 Jun 15 07:30:21 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:21 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.info" returned: 0 in 0.808s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.147s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:21 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-670db5c1-7bb3-4526-b6fb-f759bc560d70 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Create snapshot completed successfully Jun 15 07:30:21 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60" returned: 0 in 0.882s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:22 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206 Jun 15 07:30:22 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:22 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206" returned: 0 in 0.932s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:22 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206 Jun 15 07:30:22 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Flow 'volume_create_manager' (4a4ddd58-4d8e-4e9c-b02b-22de563f36a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49bcd566-9aef-4b79-82df-f60612e79f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49bcd566-9aef-4b79-82df-f60612e79f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1816710339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db19fe3b-b504-4b5d-b040-5d63b2e176c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f2a9966424d95a99984b5877b7bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:23Z,use_quota=True,user_id='e543f20d53b944d9af2f5c6c3d28abcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fbf23b-bd8a-4fed-be0b-62c9db40043f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fbf23b-bd8a-4fed-be0b-62c9db40043f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd93a624-3dd8-4746-bcc7-c252b182ffbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd93a624-3dd8-4746-bcc7-c252b182ffbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db19fe3b-b504-4b5d-b040-5d63b2e176c3', 'volume_name': 'volume-db19fe3b-b504-4b5d-b040-5d63b2e176c3', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d6c9a3-8403-4fda-af97-5ae5b71b025c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d6c9a3-8403-4fda-af97-5ae5b71b025c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (989ff130-43f4-4912-be9d-b3902357b153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:23 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume db19fe3b-b504-4b5d-b040-5d63b2e176c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db19fe3b-b504-4b5d-b040-5d63b2e176c3', 'volume_size': 1} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1816710339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db19fe3b-b504-4b5d-b040-5d63b2e176c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f2a9966424d95a99984b5877b7bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:23Z,use_quota=True,user_id='e543f20d53b944d9af2f5c6c3d28abcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Creating volume db19fe3b-b504-4b5d-b040-5d63b2e176c3 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:23 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db19fe3b-b504-4b5d-b040-5d63b2e176c3 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] Acquiring lock "cinder-1a758694-d9c4-4d28-8e96-6928c3ce88d8-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:23 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db19fe3b-b504-4b5d-b040-5d63b2e176c3 1073741824 Jun 15 07:30:23 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "cinder-1a758694-d9c4-4d28-8e96-6928c3ce88d8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] Acquiring lock "cinder-quobyte-1a758694-d9c4-4d28-8e96-6928c3ce88d8" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "cinder-quobyte-1a758694-d9c4-4d28-8e96-6928c3ce88d8" acquired by "delete_volume" :: waited 0.026s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[164bd67e-0621-433e-8c48-b639d328828e]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Flow 'volume_create_manager' (6d53e24a-1887-4fc5-891c-19bb0da09799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:23 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8 Jun 15 07:30:23 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952b4f80-d4db-4e09-b40a-77a44a8d528b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952b4f80-d4db-4e09-b40a-77a44a8d528b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-431476560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62016429-9f99-4a68-a835-d3dedc511c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f2a9966424d95a99984b5877b7bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:23Z,use_quota=True,user_id='e543f20d53b944d9af2f5c6c3d28abcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09be910c-e62e-4c42-bbc8-23a235872fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09be910c-e62e-4c42-bbc8-23a235872fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296cd308-5eea-415e-bb55-2cb56c96fe1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296cd308-5eea-415e-bb55-2cb56c96fe1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62016429-9f99-4a68-a835-d3dedc511c94', 'volume_name': 'volume-62016429-9f99-4a68-a835-d3dedc511c94', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0cd19b-4584-4a03-abd2-e2717a0c2828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0cd19b-4584-4a03-abd2-e2717a0c2828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a183c41-e5cf-4b0e-b741-01066fe5fcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:23 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume 62016429-9f99-4a68-a835-d3dedc511c94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62016429-9f99-4a68-a835-d3dedc511c94', 'volume_size': 1} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:23 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60.6f2d257a-1199-4798-80e4-bc986494b206" returned: 0 in 0.976s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-6f2d257a-1199-4798-80e4-bc986494b206" released by "_delete_snapshot" :: held 3.731s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-4c757319-2fea-4f54-a1cf-29918126da60" released by "delete_snapshot" :: held 3.795s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] Created reservations ['05fc6264-c667-4b0b-8116-32a63415bb29', '9d9be587-2b44-47be-88b5-cf04134c8358', 'a864d304-0108-44d0-8f67-02936603118a', 'ad7e2cad-17c3-4dce-92ff-c7b11cdf1066'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Flow 'volume_create_manager' (53c25a3c-df43-4dbf-a137-49a7c5984a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43858b31-6e66-407a-ab59-2aed58df5c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43858b31-6e66-407a-ab59-2aed58df5c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-201894159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70fc25ed-cfb7-4f65-9854-eac1203adda9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f2a9966424d95a99984b5877b7bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:24Z,use_quota=True,user_id='e543f20d53b944d9af2f5c6c3d28abcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233a5301-1d7c-451b-a81d-a297f9579922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233a5301-1d7c-451b-a81d-a297f9579922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ab9b39-785b-4af1-9d24-4fa02ae3327d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ab9b39-785b-4af1-9d24-4fa02ae3327d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70fc25ed-cfb7-4f65-9854-eac1203adda9', 'volume_name': 'volume-70fc25ed-cfb7-4f65-9854-eac1203adda9', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869ec433-4c58-4413-8fca-d35e303bc6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869ec433-4c58-4413-8fca-d35e303bc6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f903c98d-a3d6-436a-a194-521fdcd1ef2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:24 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume 70fc25ed-cfb7-4f65-9854-eac1203adda9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70fc25ed-cfb7-4f65-9854-eac1203adda9', 'volume_size': 1} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:24 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] Delete snapshot completed successfully. Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-09d34466-0507-47ef-abf0-47af929756d8 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-6f2d257a-1199-4798-80e4-bc986494b206-delete_snapshot" released by "delete_snapshot" :: held 4.224s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:24 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db19fe3b-b504-4b5d-b040-5d63b2e176c3 1073741824" returned: 0 in 1.337s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db19fe3b-b504-4b5d-b040-5d63b2e176c3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:24 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db19fe3b-b504-4b5d-b040-5d63b2e176c3 Jun 15 07:30:24 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:24 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Flow 'volume_create_manager' (1e1f3dd2-0a74-4b7c-ad8a-17fdcc581cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a49bc8-b89f-4ad3-a31b-6f67f6faaed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8" returned: 0 in 1.322s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-4c757319-2fea-4f54-a1cf-29918126da60-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a49bc8-b89f-4ad3-a31b-6f67f6faaed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1249318247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f4f700-bc93-43ca-847f-ca2e03099f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f2a9966424d95a99984b5877b7bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:25Z,use_quota=True,user_id='e543f20d53b944d9af2f5c6c3d28abcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:24 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8 Jun 15 07:30:24 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb2bc11-12fb-4556-ba7d-68338ca9764a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb2bc11-12fb-4556-ba7d-68338ca9764a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f942f652-ce8b-4605-b835-4c19721a78bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f942f652-ce8b-4605-b835-4c19721a78bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f4f700-bc93-43ca-847f-ca2e03099f01', 'volume_name': 'volume-12f4f700-bc93-43ca-847f-ca2e03099f01', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f6bf11-002d-492c-aeee-10b295350723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f6bf11-002d-492c-aeee-10b295350723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52954d69-3848-40ce-9fb5-c7a3267ea95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:24 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume 12f4f700-bc93-43ca-847f-ca2e03099f01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f4f700-bc93-43ca-847f-ca2e03099f01', 'volume_size': 1} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-4c757319-2fea-4f54-a1cf-29918126da60-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-quobyte-4c757319-2fea-4f54-a1cf-29918126da60" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-4c757319-2fea-4f54-a1cf-29918126da60" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4f4c19-2355-4ea1-b878-19961bd99e04]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:25 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 Jun 15 07:30:25 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Flow 'volume_create_manager' (ba06ea21-828a-4b7d-8fd7-214bccce1354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98abc719-eb9b-4f2e-89a0-cfd21889c8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98abc719-eb9b-4f2e-89a0-cfd21889c8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-267237548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db8b1ea9-3202-42d6-b4b6-38295874cc48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f2a9966424d95a99984b5877b7bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:25Z,use_quota=True,user_id='e543f20d53b944d9af2f5c6c3d28abcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028533a5-536b-4aec-86ae-df706fb427a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028533a5-536b-4aec-86ae-df706fb427a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aea988a-8ce8-4ea3-a86d-2230cc1c05fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aea988a-8ce8-4ea3-a86d-2230cc1c05fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db8b1ea9-3202-42d6-b4b6-38295874cc48', 'volume_name': 'volume-db8b1ea9-3202-42d6-b4b6-38295874cc48', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1937a01-a6d8-48d4-b137-88fe9efa632a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1937a01-a6d8-48d4-b137-88fe9efa632a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7255e4-7026-4529-ab9a-13edbf5d7657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:25 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume db8b1ea9-3202-42d6-b4b6-38295874cc48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db8b1ea9-3202-42d6-b4b6-38295874cc48', 'volume_size': 1} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:25 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db19fe3b-b504-4b5d-b040-5d63b2e176c3" returned: 0 in 0.996s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] <== create_volume: return (2431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.434s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.970s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-431476560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62016429-9f99-4a68-a835-d3dedc511c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f2a9966424d95a99984b5877b7bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:23Z,use_quota=True,user_id='e543f20d53b944d9af2f5c6c3d28abcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Creating volume 62016429-9f99-4a68-a835-d3dedc511c94 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:25 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62016429-9f99-4a68-a835-d3dedc511c94 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (989ff130-43f4-4912-be9d-b3902357b153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db19fe3b-b504-4b5d-b040-5d63b2e176c3', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:25 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62016429-9f99-4a68-a835-d3dedc511c94 1073741824 Jun 15 07:30:25 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f63135-3057-4154-9665-de59b8dd224b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:25 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1a758694-d9c4-4d28-8e96-6928c3ce88d8" returned: 0 in 1.012s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "cinder-quobyte-1a758694-d9c4-4d28-8e96-6928c3ce88d8" released by "delete_volume" :: held 2.439s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:25 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume volume-db19fe3b-b504-4b5d-b040-5d63b2e176c3 (db19fe3b-b504-4b5d-b040-5d63b2e176c3): created successfully Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f63135-3057-4154-9665-de59b8dd224b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Flow 'volume_create_manager' (4a4ddd58-4d8e-4e9c-b02b-22de563f36a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:25 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-6eab85f2-866d-4d08-832b-420ed6a480a7 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Created volume successfully. Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] Created reservations ['16908b03-7070-4008-9215-d140bc74bd5e', '247bab58-cbb9-426f-b66a-c8980cbf954a', '43f17887-511b-4620-b313-fb899143b138', 'f6865b2e-d0e9-4f80-8a2e-814fd483ba1e'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:25 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:30:25 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:26 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60" returned: 0 in 1.173s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:26 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60 Jun 15 07:30:26 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:26 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.709s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:26 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:26 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] Deleted volume successfully. Jun 15 07:30:26 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-acb9d251-0ae7-41d7-b6b2-4f02ba05fab8 tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "cinder-1a758694-d9c4-4d28-8e96-6928c3ce88d8-delete_volume" released by "delete_volume" :: held 3.416s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62016429-9f99-4a68-a835-d3dedc511c94 1073741824" returned: 0 in 1.031s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] Acquiring lock "cinder-becf5b11-f584-4087-a0fe-4480a2973c7d-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "cinder-becf5b11-f584-4087-a0fe-4480a2973c7d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62016429-9f99-4a68-a835-d3dedc511c94 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:26 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62016429-9f99-4a68-a835-d3dedc511c94 Jun 15 07:30:26 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] Acquiring lock "cinder-quobyte-becf5b11-f584-4087-a0fe-4480a2973c7d" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "cinder-quobyte-becf5b11-f584-4087-a0fe-4480a2973c7d" acquired by "delete_volume" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:26 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[885ccf50-cbb9-4bd8-a9f2-c3657d1e33c0]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-becf5b11-f584-4087-a0fe-4480a2973c7d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:26 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-becf5b11-f584-4087-a0fe-4480a2973c7d Jun 15 07:30:26 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:27 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4c757319-2fea-4f54-a1cf-29918126da60" returned: 0 in 0.873s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-4c757319-2fea-4f54-a1cf-29918126da60" released by "delete_volume" :: held 2.199s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] Created reservations ['397b8372-df18-47a6-a9e4-8ecf06bc4164', 'e46c35d1-fbce-43ad-a94d-8462fe3b9f88', 'c88cdf86-7188-4ebb-aba3-7c065ffe0065', '5c3c45b2-5d69-4715-b4a1-4396de8db4ab'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:27 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:30:27 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:27 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62016429-9f99-4a68-a835-d3dedc511c94" returned: 0 in 0.722s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.135s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-201894159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70fc25ed-cfb7-4f65-9854-eac1203adda9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f2a9966424d95a99984b5877b7bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:24Z,use_quota=True,user_id='e543f20d53b944d9af2f5c6c3d28abcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Creating volume 70fc25ed-cfb7-4f65-9854-eac1203adda9 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:27 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-70fc25ed-cfb7-4f65-9854-eac1203adda9 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a183c41-e5cf-4b0e-b741-01066fe5fcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62016429-9f99-4a68-a835-d3dedc511c94', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe033e5-4de1-4135-aa78-8e10f744b4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:27 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-70fc25ed-cfb7-4f65-9854-eac1203adda9 1073741824 Jun 15 07:30:27 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:27 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume volume-62016429-9f99-4a68-a835-d3dedc511c94 (62016429-9f99-4a68-a835-d3dedc511c94): created successfully Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe033e5-4de1-4135-aa78-8e10f744b4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Flow 'volume_create_manager' (6d53e24a-1887-4fc5-891c-19bb0da09799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:27 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-219e2e84-a327-41fb-96d9-d08093e14c32 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Created volume successfully. Jun 15 07:30:27 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-becf5b11-f584-4087-a0fe-4480a2973c7d" returned: 0 in 0.896s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-becf5b11-f584-4087-a0fe-4480a2973c7d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:27 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-becf5b11-f584-4087-a0fe-4480a2973c7d Jun 15 07:30:27 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:28 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.698s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:28 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] Deleted volume successfully. Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-72f14393-a3fa-42ab-93c1-f1337343ee80 tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-4c757319-2fea-4f54-a1cf-29918126da60-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "cinder-quobyte-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b" acquired by "delete_volume" :: waited 0.018s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad30f081-170c-40d0-937b-f9f5dd8ceeef]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:28 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-becf5b11-f584-4087-a0fe-4480a2973c7d" returned: 0 in 0.807s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "cinder-quobyte-becf5b11-f584-4087-a0fe-4480a2973c7d" released by "delete_volume" :: held 1.764s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:28 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-70fc25ed-cfb7-4f65-9854-eac1203adda9 1073741824" returned: 0 in 1.114s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:28 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b Jun 15 07:30:28 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-70fc25ed-cfb7-4f65-9854-eac1203adda9 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] Created reservations ['f15fd397-ce8f-48cb-a7a4-97ab4bc34180', '44faf539-fc32-4612-86b7-3f47b06f372a', '27804bb7-830f-4d35-8f8f-3c2de9949d26', '2545a1ed-90dc-45f7-b199-04a3245ae665'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:28 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-70fc25ed-cfb7-4f65-9854-eac1203adda9 Jun 15 07:30:28 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:28 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:30:28 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:29 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-70fc25ed-cfb7-4f65-9854-eac1203adda9" returned: 0 in 0.841s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.645s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1249318247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f4f700-bc93-43ca-847f-ca2e03099f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f2a9966424d95a99984b5877b7bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:25Z,use_quota=True,user_id='e543f20d53b944d9af2f5c6c3d28abcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Creating volume 12f4f700-bc93-43ca-847f-ca2e03099f01 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:29 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-12f4f700-bc93-43ca-847f-ca2e03099f01 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:29 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-12f4f700-bc93-43ca-847f-ca2e03099f01 1073741824 Jun 15 07:30:29 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f903c98d-a3d6-436a-a194-521fdcd1ef2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70fc25ed-cfb7-4f65-9854-eac1203adda9', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e82fa8-48f9-436b-9d43-92538acc4288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:29 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume volume-70fc25ed-cfb7-4f65-9854-eac1203adda9 (70fc25ed-cfb7-4f65-9854-eac1203adda9): created successfully Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e82fa8-48f9-436b-9d43-92538acc4288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:29 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Flow 'volume_create_manager' (53c25a3c-df43-4dbf-a137-49a7c5984a3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b" returned: 0 in 1.152s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:29 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c923175e-1db5-4e27-bca7-0c60b0699c08 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Created volume successfully. Jun 15 07:30:29 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b Jun 15 07:30:29 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:29 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.987s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:29 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] Deleted volume successfully. Jun 15 07:30:29 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6cc759ff-92ff-4bd4-b654-96138326dc52 tempest-TestServerVolumeAttachmentScenario-699393607 None] Lock "cinder-becf5b11-f584-4087-a0fe-4480a2973c7d-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:30 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b" returned: 0 in 0.805s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:30 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-quobyte-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b" released by "delete_volume" :: held 2.027s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:30 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=101,cinder:UPDATE=110,cinder:INSERT=27,cinder:DELETE=7 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:30:30 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=92,cinder:UPDATE=103,cinder:DELETE=11,cinder:INSERT=30 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:30:30 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] Created reservations ['e2089ee6-113d-41f9-be1d-d4c8f8e5f49f', 'e57c3044-3853-4845-adf5-33d6e433ba38', '72665994-9560-4933-87d7-651ab98d4ddc', '44d77784-0ed7-4d42-b58d-f3156c6dbaaf'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:30 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-12f4f700-bc93-43ca-847f-ca2e03099f01 1073741824" returned: 0 in 1.242s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:30 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:30:30 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-12f4f700-bc93-43ca-847f-ca2e03099f01 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:30 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-12f4f700-bc93-43ca-847f-ca2e03099f01 Jun 15 07:30:30 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:31 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:31 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.791s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-12f4f700-bc93-43ca-847f-ca2e03099f01" returned: 0 in 0.747s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.027s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-267237548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db8b1ea9-3202-42d6-b4b6-38295874cc48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f2a9966424d95a99984b5877b7bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:25Z,use_quota=True,user_id='e543f20d53b944d9af2f5c6c3d28abcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Creating volume db8b1ea9-3202-42d6-b4b6-38295874cc48 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:31 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db8b1ea9-3202-42d6-b4b6-38295874cc48 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:31 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] Deleted volume successfully. Jun 15 07:30:31 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db8b1ea9-3202-42d6-b4b6-38295874cc48 1073741824 Jun 15 07:30:31 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52954d69-3848-40ce-9fb5-c7a3267ea95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f4f700-bc93-43ca-847f-ca2e03099f01', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e423cc3-8021-44c9-9043-3d646dae8a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bec5c626-6539-4624-a31c-68d615ff7d4b tempest-VolumesSnapshotTestJSON-1272434108 None] Lock "cinder-b8b207b8-e8f3-4b5f-9fbb-e8ac420a537b-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:31 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume volume-12f4f700-bc93-43ca-847f-ca2e03099f01 (12f4f700-bc93-43ca-847f-ca2e03099f01): created successfully Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e423cc3-8021-44c9-9043-3d646dae8a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Flow 'volume_create_manager' (1e1f3dd2-0a74-4b7c-ad8a-17fdcc581cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:31 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-dff2b72d-7fa4-491b-bdd9-57ad6ea05f84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Created volume successfully. Jun 15 07:30:32 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db8b1ea9-3202-42d6-b4b6-38295874cc48 1073741824" returned: 0 in 1.013s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db8b1ea9-3202-42d6-b4b6-38295874cc48 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:32 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db8b1ea9-3202-42d6-b4b6-38295874cc48 Jun 15 07:30:32 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:33 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db8b1ea9-3202-42d6-b4b6-38295874cc48" returned: 0 in 0.704s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7255e4-7026-4529-ab9a-13edbf5d7657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db8b1ea9-3202-42d6-b4b6-38295874cc48', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f62a2c-9f17-4cf0-8b80-70a0d67b4ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:33 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Volume volume-db8b1ea9-3202-42d6-b4b6-38295874cc48 (db8b1ea9-3202-42d6-b4b6-38295874cc48): created successfully Jun 15 07:30:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f62a2c-9f17-4cf0-8b80-70a0d67b4ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Flow 'volume_create_manager' (ba06ea21-828a-4b7d-8fd7-214bccce1354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:33 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f320c7df-bfa6-490f-8839-9be16085390b tempest-CreateVolumesFromSnapshotTest-1147828828 None] Created volume successfully. Jun 15 07:30:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "cinder-db8b1ea9-3202-42d6-b4b6-38295874cc48-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-db8b1ea9-3202-42d6-b4b6-38295874cc48-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "cinder-quobyte-db8b1ea9-3202-42d6-b4b6-38295874cc48" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-quobyte-db8b1ea9-3202-42d6-b4b6-38295874cc48" acquired by "delete_volume" :: waited 0.018s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:34 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdd2f01-450b-4328-957a-80b4c92d3dfa]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db8b1ea9-3202-42d6-b4b6-38295874cc48 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:34 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db8b1ea9-3202-42d6-b4b6-38295874cc48 Jun 15 07:30:34 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:35 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db8b1ea9-3202-42d6-b4b6-38295874cc48" returned: 0 in 0.914s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db8b1ea9-3202-42d6-b4b6-38295874cc48 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:35 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db8b1ea9-3202-42d6-b4b6-38295874cc48 Jun 15 07:30:35 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:36 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db8b1ea9-3202-42d6-b4b6-38295874cc48" returned: 0 in 0.679s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-quobyte-db8b1ea9-3202-42d6-b4b6-38295874cc48" released by "delete_volume" :: held 1.654s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:36 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Created reservations ['8356300c-6bff-4696-896a-0b1aa5a7258b', '3f5fc15a-07c8-441f-8ba5-8de1710e1192', 'c5c83138-7703-489a-b1c9-cbafbd92d98a', 'cc427b77-31da-4184-9919-4396dac3b4f9'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:36 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:36 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:30:36 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "cinder-12f4f700-bc93-43ca-847f-ca2e03099f01-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-12f4f700-bc93-43ca-847f-ca2e03099f01-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "cinder-quobyte-12f4f700-bc93-43ca-847f-ca2e03099f01" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-quobyte-12f4f700-bc93-43ca-847f-ca2e03099f01" acquired by "delete_volume" :: waited 0.085s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:37 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b445cce8-85f3-4d47-b860-697d0234b896]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-12f4f700-bc93-43ca-847f-ca2e03099f01 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:37 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-12f4f700-bc93-43ca-847f-ca2e03099f01 Jun 15 07:30:37 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:37 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.975s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:37 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:37 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Deleted volume successfully. Jun 15 07:30:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-af43a612-432c-4227-bf04-4eed0c7bc437 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-db8b1ea9-3202-42d6-b4b6-38295874cc48-delete_volume" released by "delete_volume" :: held 2.897s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:38 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-12f4f700-bc93-43ca-847f-ca2e03099f01" returned: 0 in 1.091s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-12f4f700-bc93-43ca-847f-ca2e03099f01 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:38 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-12f4f700-bc93-43ca-847f-ca2e03099f01 Jun 15 07:30:38 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:39 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-12f4f700-bc93-43ca-847f-ca2e03099f01" returned: 0 in 0.830s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-quobyte-12f4f700-bc93-43ca-847f-ca2e03099f01" released by "delete_volume" :: held 2.040s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:39 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Created reservations ['510004dd-c1cf-4aaa-aae8-b08d86ffb4b3', '799c6310-039f-4aaa-acb8-6aca0d639d39', 'f999830f-f52d-459a-af43-11ced3860a8d', '9153a620-718c-48c8-935c-21507af9cb82'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:39 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:30:39 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:40 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.753s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:40 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:40 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Deleted volume successfully. Jun 15 07:30:40 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-966b375e-45b7-4f61-8b12-f6abd9685b52 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-12f4f700-bc93-43ca-847f-ca2e03099f01-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:40 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "cinder-70fc25ed-cfb7-4f65-9854-eac1203adda9-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:40 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-70fc25ed-cfb7-4f65-9854-eac1203adda9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:40 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "cinder-quobyte-70fc25ed-cfb7-4f65-9854-eac1203adda9" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:40 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-quobyte-70fc25ed-cfb7-4f65-9854-eac1203adda9" acquired by "delete_volume" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:40 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[333bf22b-ded5-49f1-b36a-843135583a6a]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-70fc25ed-cfb7-4f65-9854-eac1203adda9 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:40 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-70fc25ed-cfb7-4f65-9854-eac1203adda9 Jun 15 07:30:40 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:41 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-70fc25ed-cfb7-4f65-9854-eac1203adda9" returned: 0 in 0.911s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-70fc25ed-cfb7-4f65-9854-eac1203adda9 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:41 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-70fc25ed-cfb7-4f65-9854-eac1203adda9 Jun 15 07:30:41 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:42 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-70fc25ed-cfb7-4f65-9854-eac1203adda9" returned: 0 in 0.750s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-quobyte-70fc25ed-cfb7-4f65-9854-eac1203adda9" released by "delete_volume" :: held 1.723s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:42 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Created reservations ['c3a8850b-40d3-4396-8882-ce49938d478b', 'fdacdd97-40fe-4bb8-93a3-dd3f5a9bbbe1', '172e2a90-33ca-4727-b8b2-e848eee22a61', 'ec5b69fc-66da-4448-81f7-05b1f81063ea'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:42 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:30:42 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "cinder-62016429-9f99-4a68-a835-d3dedc511c94-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-62016429-9f99-4a68-a835-d3dedc511c94-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "cinder-quobyte-62016429-9f99-4a68-a835-d3dedc511c94" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:42 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Flow 'volume_create_manager' (2b8fa1e0-4e29-41e6-9b71-c2f1ec377359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859c9ada-754e-4710-aa0f-ed39cc6c85c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859c9ada-754e-4710-aa0f-ed39cc6c85c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-90346637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9305566-0d69-41af-8407-7887220d6d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf24b41d0d241ffb4b39e958174dfc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:43Z,use_quota=True,user_id='04686f0d8b8c4f719d99b37052020e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98568531-2417-457d-a89e-a6f5bdeab118),volume_type_id=98568531-2417-457d-a89e-a6f5bdeab118)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6358ce04-c70d-4662-b455-475dbbc99d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6358ce04-c70d-4662-b455-475dbbc99d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3bab03-6a56-4743-ac76-f4d033ba4dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3bab03-6a56-4743-ac76-f4d033ba4dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9305566-0d69-41af-8407-7887220d6d70', 'volume_name': 'volume-f9305566-0d69-41af-8407-7887220d6d70', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac94f20b-c895-4d57-9ffe-5797aa6db58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac94f20b-c895-4d57-9ffe-5797aa6db58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc73323-64f6-40e2-a2f8-8721d30fbf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:43 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Volume f9305566-0d69-41af-8407-7887220d6d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9305566-0d69-41af-8407-7887220d6d70', 'volume_size': 1} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-90346637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9305566-0d69-41af-8407-7887220d6d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf24b41d0d241ffb4b39e958174dfc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:43Z,use_quota=True,user_id='04686f0d8b8c4f719d99b37052020e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98568531-2417-457d-a89e-a6f5bdeab118),volume_type_id=98568531-2417-457d-a89e-a6f5bdeab118)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Creating volume f9305566-0d69-41af-8407-7887220d6d70 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:43 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f9305566-0d69-41af-8407-7887220d6d70 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-quobyte-62016429-9f99-4a68-a835-d3dedc511c94" acquired by "delete_volume" :: waited 0.216s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:43 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f9305566-0d69-41af-8407-7887220d6d70 1073741824 Jun 15 07:30:43 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c17824e-7c7c-4a30-af24-2de8b271e0ce]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62016429-9f99-4a68-a835-d3dedc511c94 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:43 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62016429-9f99-4a68-a835-d3dedc511c94 Jun 15 07:30:43 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:43 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.187s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Flow 'volume_create_manager' (b0c59af5-6040-4dbe-a269-0672c5fedbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c768e0-aa84-4e37-9ed1-84caee8ff19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:43 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Deleted volume successfully. Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c768e0-aa84-4e37-9ed1-84caee8ff19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1657114522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46fff9d0-3656-4f88-beb0-bd5958862b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf24b41d0d241ffb4b39e958174dfc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:43Z,use_quota=True,user_id='04686f0d8b8c4f719d99b37052020e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(698a4e13-f5a5-4c22-9d93-4cfc614de7ae),volume_type_id=698a4e13-f5a5-4c22-9d93-4cfc614de7ae)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df5518d-f0cd-459d-b10f-beaef8907675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df5518d-f0cd-459d-b10f-beaef8907675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75014b4-cd7d-4342-9645-9b30a6f17b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75014b4-cd7d-4342-9645-9b30a6f17b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46fff9d0-3656-4f88-beb0-bd5958862b7f', 'volume_name': 'volume-46fff9d0-3656-4f88-beb0-bd5958862b7f', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd0f043-0ad0-4c1d-83cd-eba259970336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd0f043-0ad0-4c1d-83cd-eba259970336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa0270e-487c-4502-bbb7-6661259a5ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:43 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Volume 46fff9d0-3656-4f88-beb0-bd5958862b7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46fff9d0-3656-4f88-beb0-bd5958862b7f', 'volume_size': 1} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0993ac3a-be9c-4a08-8fb2-bb7da8114952 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-70fc25ed-cfb7-4f65-9854-eac1203adda9-delete_volume" released by "delete_volume" :: held 3.442s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:44 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f9305566-0d69-41af-8407-7887220d6d70 1073741824" returned: 0 in 1.409s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f9305566-0d69-41af-8407-7887220d6d70 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:44 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f9305566-0d69-41af-8407-7887220d6d70 Jun 15 07:30:44 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:44 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62016429-9f99-4a68-a835-d3dedc511c94" returned: 0 in 1.460s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62016429-9f99-4a68-a835-d3dedc511c94 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:44 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Flow 'volume_create_manager' (211f39ff-c439-48e4-92c9-a060583a6d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:44 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62016429-9f99-4a68-a835-d3dedc511c94 Jun 15 07:30:44 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75a4431-e042-4bec-abd6-b9b560ec63b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75a4431-e042-4bec-abd6-b9b560ec63b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-868483772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf24655c-85c0-4f76-9bb2-180f451b1300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf24b41d0d241ffb4b39e958174dfc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:45Z,use_quota=True,user_id='04686f0d8b8c4f719d99b37052020e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b864a60-c473-44fe-82d9-5657ecf4d174),volume_type_id=6b864a60-c473-44fe-82d9-5657ecf4d174)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c924d2d2-ff7f-4f25-b059-a5b84fe2352d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c924d2d2-ff7f-4f25-b059-a5b84fe2352d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e38eea1-c55d-42dd-9abc-b1b526beca97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:44 devstack cinder-volume[92129]: DEBUG cinder.image.glance [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Creating Keystone auth plugin from conf {{(pid=92129) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e38eea1-c55d-42dd-9abc-b1b526beca97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf24655c-85c0-4f76-9bb2-180f451b1300', 'volume_name': 'volume-cf24655c-85c0-4f76-9bb2-180f451b1300', 'volume_size': 1, 'image_id': '4a929633-739f-4518-8401-5a0481e902a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a929633-739f-4518-8401-5a0481e902a6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1601413689', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eaf24b41d0d241ffb4b39e958174dfc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a929633-739f-4518-8401-5a0481e902a6', 'created_at': datetime.datetime(2026, 6, 15, 5, 30, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 30, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a929633-739f-4518-8401-5a0481e902a6/file', 'properties': {}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f83131-48df-4f65-80eb-1beb671893a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f83131-48df-4f65-80eb-1beb671893a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f9d0e7-a208-4c67-aeef-abb98e5b5f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:45 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Volume cf24655c-85c0-4f76-9bb2-180f451b1300: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf24655c-85c0-4f76-9bb2-180f451b1300', 'volume_size': 1, 'image_id': '4a929633-739f-4518-8401-5a0481e902a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a929633-739f-4518-8401-5a0481e902a6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1601413689', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eaf24b41d0d241ffb4b39e958174dfc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a929633-739f-4518-8401-5a0481e902a6', 'created_at': datetime.datetime(2026, 6, 15, 5, 30, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 30, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a929633-739f-4518-8401-5a0481e902a6/file', 'properties': {}}, 'image_service': } Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Trying to clone cf24655c-85c0-4f76-9bb2-180f451b1300 from image 4a929633-739f-4518-8401-5a0481e902a6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4a929633-739f-4518-8401-5a0481e902a6', 'metadata': {}}]). {{(pid=92129) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:30:45 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f9305566-0d69-41af-8407-7887220d6d70" returned: 0 in 0.996s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] <== create_volume: return (2465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.468s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.665s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1657114522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46fff9d0-3656-4f88-beb0-bd5958862b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf24b41d0d241ffb4b39e958174dfc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:43Z,use_quota=True,user_id='04686f0d8b8c4f719d99b37052020e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(698a4e13-f5a5-4c22-9d93-4cfc614de7ae),volume_type_id=698a4e13-f5a5-4c22-9d93-4cfc614de7ae)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Creating volume 46fff9d0-3656-4f88-beb0-bd5958862b7f {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:45 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46fff9d0-3656-4f88-beb0-bd5958862b7f 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:45 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc73323-64f6-40e2-a2f8-8721d30fbf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9305566-0d69-41af-8407-7887220d6d70', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:45 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46fff9d0-3656-4f88-beb0-bd5958862b7f 1073741824 Jun 15 07:30:45 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63216535-d8e7-4d25-b434-4b21cec0c7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62016429-9f99-4a68-a835-d3dedc511c94" returned: 0 in 0.958s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-quobyte-62016429-9f99-4a68-a835-d3dedc511c94" released by "delete_volume" :: held 2.531s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:45 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Volume volume-f9305566-0d69-41af-8407-7887220d6d70 (f9305566-0d69-41af-8407-7887220d6d70): created successfully Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63216535-d8e7-4d25-b434-4b21cec0c7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Flow 'volume_create_manager' (2b8fa1e0-4e29-41e6-9b71-c2f1ec377359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:45 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-d19a6da4-4bb2-4c73-983b-ce555d085ff8 tempest-TestInstancesWithCinderVolumes-1927119799 None] Created volume successfully. Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Created reservations ['ef1fa53d-8371-402b-a328-07c7757803b0', 'b4a0f0b2-dcab-4a68-b940-c4d4db953f8b', '1a6e2404-1fd8-41a8-9809-82e2081de89a', 'c7df50ab-535a-4753-8286-d1170a1d4db3'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:45 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:30:45 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "cinder-db19fe3b-b504-4b5d-b040-5d63b2e176c3-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-db19fe3b-b504-4b5d-b040-5d63b2e176c3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "cinder-quobyte-db19fe3b-b504-4b5d-b040-5d63b2e176c3" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-quobyte-db19fe3b-b504-4b5d-b040-5d63b2e176c3" acquired by "delete_volume" :: waited 0.023s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:46 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c1255c-3ff5-4ab2-9f93-95f1fe0291fc]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db19fe3b-b504-4b5d-b040-5d63b2e176c3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:46 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db19fe3b-b504-4b5d-b040-5d63b2e176c3 Jun 15 07:30:46 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:46 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46fff9d0-3656-4f88-beb0-bd5958862b7f 1073741824" returned: 0 in 1.208s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46fff9d0-3656-4f88-beb0-bd5958862b7f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:46 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46fff9d0-3656-4f88-beb0-bd5958862b7f Jun 15 07:30:46 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:47 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.330s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:47 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:47 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Deleted volume successfully. Jun 15 07:30:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b9dd0f09-e252-4e36-b310-85f00667eb84 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-62016429-9f99-4a68-a835-d3dedc511c94-delete_volume" released by "delete_volume" :: held 4.496s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:47 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db19fe3b-b504-4b5d-b040-5d63b2e176c3" returned: 0 in 1.349s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db19fe3b-b504-4b5d-b040-5d63b2e176c3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:47 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46fff9d0-3656-4f88-beb0-bd5958862b7f" returned: 0 in 1.027s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:47 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] <== create_volume: return (2323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.326s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:47 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db19fe3b-b504-4b5d-b040-5d63b2e176c3 Jun 15 07:30:47 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa0270e-487c-4502-bbb7-6661259a5ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46fff9d0-3656-4f88-beb0-bd5958862b7f', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7b398d-0cbd-421b-8de4-0e5d61a291ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:47 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Volume volume-46fff9d0-3656-4f88-beb0-bd5958862b7f (46fff9d0-3656-4f88-beb0-bd5958862b7f): created successfully Jun 15 07:30:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7b398d-0cbd-421b-8de4-0e5d61a291ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:47 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Flow 'volume_create_manager' (b0c59af5-6040-4dbe-a269-0672c5fedbd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:47 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-aed9ad0c-a5d9-49c3-b0f8-1c8723628e3b tempest-TestInstancesWithCinderVolumes-1927119799 None] Created volume successfully. Jun 15 07:30:48 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-db19fe3b-b504-4b5d-b040-5d63b2e176c3" returned: 0 in 0.779s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-quobyte-db19fe3b-b504-4b5d-b040-5d63b2e176c3" released by "delete_volume" :: held 2.195s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:48 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Created reservations ['be858334-d352-49c3-8641-c25b05f2e573', '6f77fc6f-0eed-4acb-952f-6e9cbcb31748', 'af0d5583-1734-4f21-aee7-32131da7f8bc', 'b57fb1ed-6a17-486c-91a1-9335f3947ffa'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:48 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:30:48 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "cinder-44fb5f44-8c8f-4a11-881f-34c83c324629-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:49 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.042s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:49 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-44fb5f44-8c8f-4a11-881f-34c83c324629-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "cinder-quobyte-f5b81778-b622-4892-86b0-ced1d1a3a737" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:49 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Deleted volume successfully. Jun 15 07:30:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-quobyte-f5b81778-b622-4892-86b0-ced1d1a3a737" acquired by "delete_snapshot" :: waited 0.045s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "cinder-quobyte-44fb5f44-8c8f-4a11-881f-34c83c324629" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-17b0d7f1-b451-4819-869e-cb7273012e74 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-db19fe3b-b504-4b5d-b040-5d63b2e176c3-delete_volume" released by "delete_volume" :: held 3.529s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-quobyte-44fb5f44-8c8f-4a11-881f-34c83c324629" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Deleting offline snapshot 44fb5f44-8c8f-4a11-881f-34c83c324629 of volume f5b81778-b622-4892-86b0-ced1d1a3a737 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:30:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] snapshot_file for this snap is: volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:30:49 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1d1d5d-15c0-4c8f-9dfa-285b31b5d84e]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:50 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629 Jun 15 07:30:50 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:51 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629" returned: 0 in 1.187s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:51 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5b81778-b622-4892-86b0-ced1d1a3a737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:30:51 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6974988-9280-4eb9-9c1f-6dafe98b34f0]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:51 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4a929633-739f-4518-8401-5a0481e902a6_2ip072trdevstack@QuobyteHD, size 20.69 MB, duration 5.80 sec {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:30:51 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Image download 20.69 MB at 3.56 MB/s Jun 15 07:30:51 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737 Jun 15 07:30:51 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:51 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7eea3f-73dc-4c01-a4b8-9e2043148d97]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a929633-739f-4518-8401-5a0481e902a6_2ip072trdevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:51 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a929633-739f-4518-8401-5a0481e902a6_2ip072trdevstack@QuobyteHD Jun 15 07:30:51 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:52 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737" returned: 0 in 0.873s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:52 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629 Jun 15 07:30:52 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:52 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a929633-739f-4518-8401-5a0481e902a6_2ip072trdevstack@QuobyteHD" returned: 0 in 0.871s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:52 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Temporary image 4a929633-739f-4518-8401-5a0481e902a6 is fetched for user 04686f0d8b8c4f719d99b37052020e7e. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:30:52 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b29ab8-5229-42b1-9e93-3dd70e699b4d]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a929633-739f-4518-8401-5a0481e902a6_2ip072trdevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:52 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a929633-739f-4518-8401-5a0481e902a6_2ip072trdevstack@QuobyteHD Jun 15 07:30:52 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:53 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629" returned: 0 in 0.979s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:53 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629 Jun 15 07:30:53 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:53 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a929633-739f-4518-8401-5a0481e902a6_2ip072trdevstack@QuobyteHD" returned: 0 in 0.921s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-868483772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf24655c-85c0-4f76-9bb2-180f451b1300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf24b41d0d241ffb4b39e958174dfc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:45Z,use_quota=True,user_id='04686f0d8b8c4f719d99b37052020e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b864a60-c473-44fe-82d9-5657ecf4d174),volume_type_id=6b864a60-c473-44fe-82d9-5657ecf4d174)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Creating volume cf24655c-85c0-4f76-9bb2-180f451b1300 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:53 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:30:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:53 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 1073741824 Jun 15 07:30:53 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:53 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737.44fb5f44-8c8f-4a11-881f-34c83c324629" returned: 0 in 0.760s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:53 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-quobyte-44fb5f44-8c8f-4a11-881f-34c83c324629" released by "_delete_snapshot" :: held 3.969s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:53 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-quobyte-f5b81778-b622-4892-86b0-ced1d1a3a737" released by "delete_snapshot" :: held 4.004s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:54 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Created reservations ['0a1ad2a5-0b4c-4186-a056-4a48b6c6bc21', '5f36938d-cb90-4ec3-8d4c-f1ea8f0ae270', '9000851e-b904-459e-bc1e-b8e6bd73106e', '16ac8bf7-4ffb-484d-9710-ed6284f2be26'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:54 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Delete snapshot completed successfully. Jun 15 07:30:54 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-4236b237-9773-433a-8261-127368a905c2 tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-44fb5f44-8c8f-4a11-881f-34c83c324629-delete_snapshot" released by "delete_snapshot" :: held 4.293s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:54 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 1073741824" returned: 0 in 1.165s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:54 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 Jun 15 07:30:54 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:55 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "cinder-f5b81778-b622-4892-86b0-ced1d1a3a737-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:55 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-f5b81778-b622-4892-86b0-ced1d1a3a737-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:55 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "cinder-quobyte-f5b81778-b622-4892-86b0-ced1d1a3a737" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:55 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-quobyte-f5b81778-b622-4892-86b0-ced1d1a3a737" acquired by "delete_volume" :: waited 0.022s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:55 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300" returned: 0 in 0.846s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:55 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:55 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[97387829-6d57-434e-97a6-b1d6c414067a]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:55 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Attempting download of 4a929633-739f-4518-8401-5a0481e902a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4a929633-739f-4518-8401-5a0481e902a6', 'metadata': {}}])) to volume cf24655c-85c0-4f76-9bb2-180f451b1300. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:30:55 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41e1554-eefa-4a84-8461-d00c47775222]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a929633-739f-4518-8401-5a0481e902a6_0r7t2876 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:55 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737 Jun 15 07:30:55 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:55 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a929633-739f-4518-8401-5a0481e902a6_0r7t2876 Jun 15 07:30:55 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:56 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a929633-739f-4518-8401-5a0481e902a6_0r7t2876" returned: 0 in 1.022s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a929633-739f-4518-8401-5a0481e902a6_0r7t2876 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:56 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737" returned: 0 in 1.178s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:56 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737 Jun 15 07:30:56 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:56 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a929633-739f-4518-8401-5a0481e902a6_0r7t2876 Jun 15 07:30:56 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:57 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f5b81778-b622-4892-86b0-ced1d1a3a737" returned: 0 in 0.776s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:57 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-quobyte-f5b81778-b622-4892-86b0-ced1d1a3a737" released by "delete_volume" :: held 2.137s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:57 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] Created reservations ['d7186eb9-38e3-44b8-8398-b0bbf4a9fcf2', 'f039ac9d-5a5e-4151-b844-dd81f083808a', 'a1bf20e8-dc18-4448-bc37-ffd8570cfb77', 'edb7a56c-36c3-4157-8ee8-5f48f982fe9a'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:57 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a929633-739f-4518-8401-5a0481e902a6_0r7t2876" returned: 1 in 1.063s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a929633-739f-4518-8401-5a0481e902a6_0r7t2876' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:30:57 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd835670-f1f9-4ceb-9c5e-431c663baff3]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a929633-739f-4518-8401-5a0481e902a6_2ip072trdevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:57 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:30:57 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:57 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a929633-739f-4518-8401-5a0481e902a6_2ip072trdevstack@QuobyteHD Jun 15 07:30:57 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:58 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.836s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:58 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:58 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] Deleted volume successfully. Jun 15 07:30:58 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b4d762ff-2fee-48e4-bb4e-5d1fdd2fd3eb tempest-CreateVolumesFromSnapshotTest-1147828828 None] Lock "cinder-f5b81778-b622-4892-86b0-ced1d1a3a737-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:58 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a929633-739f-4518-8401-5a0481e902a6_2ip072trdevstack@QuobyteHD" returned: 0 in 0.995s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:58 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] 4a929633-739f-4518-8401-5a0481e902a6 was qcow2, converting to raw {{(pid=92129) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:30:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a929633-739f-4518-8401-5a0481e902a6_2ip072trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:58 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a929633-739f-4518-8401-5a0481e902a6_2ip072trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 Jun 15 07:30:58 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:01 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a929633-739f-4518-8401-5a0481e902a6_2ip072trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300" returned: 0 in 2.566s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:01 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4a929633-739f-4518-8401-5a0481e902a6_2ip072trdevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:31:01 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Converted 112.00 MB image at 43.58 MB/s Jun 15 07:31:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:01 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 1G Jun 15 07:31:01 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:01 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 1G" returned: 0 in 0.775s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:02 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[611bec9e-dcf6-4950-a483-10d93b9480ee]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:02 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 Jun 15 07:31:02 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:02 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300" returned: 0 in 0.977s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:03 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 Jun 15 07:31:03 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:03 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300" returned: 1 in 0.767s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:31:03 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Downloaded image 4a929633-739f-4518-8401-5a0481e902a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4a929633-739f-4518-8401-5a0481e902a6', 'metadata': {}}])) to volume cf24655c-85c0-4f76-9bb2-180f451b1300 successfully. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:31:03 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Temporary image 4a929633-739f-4518-8401-5a0481e902a6 for user 04686f0d8b8c4f719d99b37052020e7e is deleted. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:31:03 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Marking volume cf24655c-85c0-4f76-9bb2-180f451b1300 as bootable. {{(pid=92129) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:31:03 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Copying metadata from image 4a929633-739f-4518-8401-5a0481e902a6 to cf24655c-85c0-4f76-9bb2-180f451b1300. {{(pid=92129) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:31:03 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Creating volume glance metadata for volume cf24655c-85c0-4f76-9bb2-180f451b1300 backed by image 4a929633-739f-4518-8401-5a0481e902a6 with: {'image_id': '4a929633-739f-4518-8401-5a0481e902a6', 'image_name': 'tempest-scenario-img--1601413689', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92129) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:31:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f9d0e7-a208-4c67-aeef-abb98e5b5f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf24655c-85c0-4f76-9bb2-180f451b1300', 'volume_size': 1, 'image_id': '4a929633-739f-4518-8401-5a0481e902a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a929633-739f-4518-8401-5a0481e902a6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1601413689', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eaf24b41d0d241ffb4b39e958174dfc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a929633-739f-4518-8401-5a0481e902a6', 'created_at': datetime.datetime(2026, 6, 15, 5, 30, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 30, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a929633-739f-4518-8401-5a0481e902a6/file', 'properties': {}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0cf8361-c331-42b1-9d53-a1e0735cedc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:03 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Volume volume-cf24655c-85c0-4f76-9bb2-180f451b1300 (cf24655c-85c0-4f76-9bb2-180f451b1300): created successfully Jun 15 07:31:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0cf8361-c331-42b1-9d53-a1e0735cedc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Flow 'volume_create_manager' (211f39ff-c439-48e4-92c9-a060583a6d09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:03 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-6e0f5962-2e3b-4235-8bfa-acf92add1021 tempest-TestInstancesWithCinderVolumes-1927119799 None] Created volume successfully. Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Flow 'volume_create_manager' (9fd5431c-b3ad-44c0-8f31-609a802901d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed23b4c-64a6-45f7-bac9-2ec70b48224e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed23b4c-64a6-45f7-bac9-2ec70b48224e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1643278330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e932ffe-9c66-486a-9cc1-eba5d9de2b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c02701b5014481a2b3be88b67ee7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:13Z,use_quota=True,user_id='006fabb687524659a71f6505b504364d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d748f2-3ca7-42b5-8ac2-54b4f8bdad6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d748f2-3ca7-42b5-8ac2-54b4f8bdad6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b24f77-706d-45f8-a2c6-892ba9eb46f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b24f77-706d-45f8-a2c6-892ba9eb46f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e932ffe-9c66-486a-9cc1-eba5d9de2b62', 'volume_name': 'volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3558e87-fb6a-43de-87ab-99ed1ea47c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3558e87-fb6a-43de-87ab-99ed1ea47c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bf2029-707c-4255-868e-33a904fa34db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:13 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Volume 4e932ffe-9c66-486a-9cc1-eba5d9de2b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62', 'volume_size': 1} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1643278330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e932ffe-9c66-486a-9cc1-eba5d9de2b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c02701b5014481a2b3be88b67ee7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:13Z,use_quota=True,user_id='006fabb687524659a71f6505b504364d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Creating volume 4e932ffe-9c66-486a-9cc1-eba5d9de2b62 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:31:13 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:13 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 1073741824 Jun 15 07:31:13 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:14 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:31:14 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:14 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 1073741824" returned: 0 in 1.097s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:14 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 Jun 15 07:31:14 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:14 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.873s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:14 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:31:14 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:31:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 28 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:31:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:31:15 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62" returned: 0 in 0.713s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:15 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:31:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bf2029-707c-4255-868e-33a904fa34db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f0d853-748c-4457-ada5-076da4e0e609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:15 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Volume volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 (4e932ffe-9c66-486a-9cc1-eba5d9de2b62): created successfully Jun 15 07:31:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f0d853-748c-4457-ada5-076da4e0e609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:15 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Flow 'volume_create_manager' (9fd5431c-b3ad-44c0-8f31-609a802901d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:15 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-d651495a-2780-43d6-b39e-8bb4a15c087c tempest-SnapshotDependencyTests-1828149333 None] Created volume successfully. Jun 15 07:31:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:15 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] Creating offline snapshot 0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 of volume 4e932ffe-9c66-486a-9cc1-eba5d9de2b62 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:31:15 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ceea925-8a39-4169-9d8c-3eec6a925bb1]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:16 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 Jun 15 07:31:16 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:16 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62" returned: 0 in 0.852s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:16 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 1G Jun 15 07:31:16 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:17 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 1G" returned: 0 in 0.975s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:17 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 Jun 15 07:31:17 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:18 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2" returned: 0 in 0.860s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:18 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 is being set with open permissions: ugo+rw Jun 15 07:31:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:18 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 Jun 15 07:31:18 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:18 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:31:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Flow 'volume_create_manager' (fb0b9628-64ff-46b6-9c52-98d0b0f63d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8748f661-0136-49f8-a0e9-bcf12da71d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8748f661-0136-49f8-a0e9-bcf12da71d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-305419767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0093b220-68a4-41e2-bb84-78656402ebec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ba99c45fdf4e4e875b1db9ed6a105b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:19Z,use_quota=True,user_id='4dd0fba840ea40aaa8a93889ff92b626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd4c753-f16e-455f-bb84-90a066735823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd4c753-f16e-455f-bb84-90a066735823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e2a6da-d81b-4f4c-9a3c-286aee79d14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e2a6da-d81b-4f4c-9a3c-286aee79d14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0093b220-68a4-41e2-bb84-78656402ebec', 'volume_name': 'volume-0093b220-68a4-41e2-bb84-78656402ebec', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e33cba-a4c6-4939-a1d6-ffe5478c8965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e33cba-a4c6-4939-a1d6-ffe5478c8965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f15dbb-1f79-4441-b779-b0d5f020b998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:18 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Volume 0093b220-68a4-41e2-bb84-78656402ebec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0093b220-68a4-41e2-bb84-78656402ebec', 'volume_size': 1} Jun 15 07:31:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-8a329609-c742-4405-a104-244dba2837ce req-cfdc6856-1fc7-480b-8709-50b5cf9d7ec7 tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:19 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2" returned: 0 in 0.767s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:19 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.info Jun 15 07:31:19 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:20 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.info" returned: 0 in 0.677s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:20 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.info is being set with open permissions: ugo+rw Jun 15 07:31:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:20 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.info Jun 15 07:31:20 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:20 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.info" returned: 0 in 0.640s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.905s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.990s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-305419767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0093b220-68a4-41e2-bb84-78656402ebec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ba99c45fdf4e4e875b1db9ed6a105b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:19Z,use_quota=True,user_id='4dd0fba840ea40aaa8a93889ff92b626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:31:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Creating volume 0093b220-68a4-41e2-bb84-78656402ebec {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:31:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:31:20 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:31:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:20 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec 1073741824 Jun 15 07:31:20 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:20 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-9c66241d-9849-4648-934f-0f8e2cdff5e9 tempest-SnapshotDependencyTests-1828149333 None] Create snapshot completed successfully Jun 15 07:31:21 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec 1073741824" returned: 0 in 0.871s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:21 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:31:21 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec Jun 15 07:31:21 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Flow 'volume_create_manager' (a78aa490-132b-4872-8b31-964568f16986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b220ce-d573-40e7-9824-236b13193c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b220ce-d573-40e7-9824-236b13193c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959d37e2-1b7a-416e-9242-4728331709ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c02701b5014481a2b3be88b67ee7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0b8d5d1f-c220-49fb-8864-f1ac4051dcd2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:22Z,use_quota=True,user_id='006fabb687524659a71f6505b504364d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eaebab7-2f5d-4c1b-b46c-4d18f0460bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eaebab7-2f5d-4c1b-b46c-4d18f0460bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ecc190-314c-4891-b4de-8013c949b3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ecc190-314c-4891-b4de-8013c949b3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '959d37e2-1b7a-416e-9242-4728331709ef', 'volume_name': 'volume-959d37e2-1b7a-416e-9242-4728331709ef', 'volume_size': 1, 'snapshot_id': '0b8d5d1f-c220-49fb-8864-f1ac4051dcd2'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558272ee-5837-470b-bd23-6dcc080f657b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558272ee-5837-470b-bd23-6dcc080f657b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b59c52-cea5-4595-832d-6ef86630e317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:21 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Volume 959d37e2-1b7a-416e-9242-4728331709ef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-959d37e2-1b7a-416e-9242-4728331709ef', 'volume_size': 1, 'snapshot_id': '0b8d5d1f-c220-49fb-8864-f1ac4051dcd2'} Jun 15 07:31:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:22 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec" returned: 0 in 0.622s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:22 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:31:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-8a329609-c742-4405-a104-244dba2837ce req-cfdc6856-1fc7-480b-8709-50b5cf9d7ec7 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.014s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f15dbb-1f79-4441-b779-b0d5f020b998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0093b220-68a4-41e2-bb84-78656402ebec', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029c069f-5c56-4344-9c14-3e53e9628b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:22 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Volume volume-0093b220-68a4-41e2-bb84-78656402ebec (0093b220-68a4-41e2-bb84-78656402ebec): created successfully Jun 15 07:31:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029c069f-5c56-4344-9c14-3e53e9628b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:22 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Flow 'volume_create_manager' (fb0b9628-64ff-46b6-9c52-98d0b0f63d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:22 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e6096d-9794-498c-9b3a-5577e0d2a1eb]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-8a329609-c742-4405-a104-244dba2837ce req-cfdc6856-1fc7-480b-8709-50b5cf9d7ec7 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:22 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-20e1ac6d-2117-4523-9813-c0311ea5badc tempest-TestStampPattern-706242272 None] Created volume successfully. Jun 15 07:31:22 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 Jun 15 07:31:22 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:23 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-8a329609-c742-4405-a104-244dba2837ce req-cfdc6856-1fc7-480b-8709-50b5cf9d7ec7 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300" returned: 0 in 0.715s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-8a329609-c742-4405-a104-244dba2837ce req-cfdc6856-1fc7-480b-8709-50b5cf9d7ec7 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:23 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 Jun 15 07:31:23 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:23 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-8a329609-c742-4405-a104-244dba2837ce req-cfdc6856-1fc7-480b-8709-50b5cf9d7ec7 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300" returned: 1 in 0.706s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-8a329609-c742-4405-a104-244dba2837ce req-cfdc6856-1fc7-480b-8709-50b5cf9d7ec7 tempest-TestInstancesWithCinderVolumes-1927119799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-8a329609-c742-4405-a104-244dba2837ce req-cfdc6856-1fc7-480b-8709-50b5cf9d7ec7 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.469s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.969s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Acquiring lock "cinder-quobyte-0b8d5d1f-c220-49fb-8864-f1ac4051dcd2-959d37e2-1b7a-416e-9242-4728331709ef" by "_create_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-quobyte-0b8d5d1f-c220-49fb-8864-f1ac4051dcd2-959d37e2-1b7a-416e-9242-4728331709ef" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Creating volume 959d37e2-1b7a-416e-9242-4728331709ef from snapshot 0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 {{(pid=92129) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Acquiring lock "cinder-quobyte-959d37e2-1b7a-416e-9242-4728331709ef" by "_copy_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-quobyte-959d37e2-1b7a-416e-9242-4728331709ef" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] snapshot: 0b8d5d1f-c220-49fb-8864-f1ac4051dcd2, volume: 959d37e2-1b7a-416e-9242-4728331709ef, {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-8a329609-c742-4405-a104-244dba2837ce req-cfdc6856-1fc7-480b-8709-50b5cf9d7ec7 tempest-TestInstancesWithCinderVolumes-1927119799 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-cf24655c-85c0-4f76-9bb2-180f451b1300', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7854ea81-afe0-433b-9de0-abde34796f09', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a85620-e1fe-4aaf-8fa1-8ad4c472d25d]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:23 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-8a329609-c742-4405-a104-244dba2837ce req-cfdc6856-1fc7-480b-8709-50b5cf9d7ec7 tempest-TestInstancesWithCinderVolumes-1927119799 None] attachment_update completed successfully. Jun 15 07:31:23 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 Jun 15 07:31:23 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:24 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2" returned: 0 in 0.845s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:31:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:31:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Creating direct copy from snapshot {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:31:24 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab8340c-f70a-4b9a-9bea-685b2952262a]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:24 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 Jun 15 07:31:24 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:25 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62" returned: 0 in 0.863s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:25 devstack cinder-volume[92129]: DEBUG cinder.utils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Path /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-959d37e2-1b7a-416e-9242-4728331709ef not found in is_blk_device check {{(pid=92129) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:31:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-959d37e2-1b7a-416e-9242-4728331709ef {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:25 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-959d37e2-1b7a-416e-9242-4728331709ef Jun 15 07:31:25 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:31 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-959d37e2-1b7a-416e-9242-4728331709ef" returned: 0 in 6.207s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:31 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6077707-c816-4e91-a9b8-1b8656d52418]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:31 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 Jun 15 07:31:31 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:32 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62" returned: 0 in 1.036s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:32 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Image conversion details: src /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-959d37e2-1b7a-416e-9242-4728331709ef {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:31:32 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Converted 1024.00 MB image at 164.90 MB/s Jun 15 07:31:32 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-959d37e2-1b7a-416e-9242-4728331709ef is being set with open permissions: ugo+rw Jun 15 07:31:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-959d37e2-1b7a-416e-9242-4728331709ef {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:32 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-959d37e2-1b7a-416e-9242-4728331709ef Jun 15 07:31:32 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:33 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-959d37e2-1b7a-416e-9242-4728331709ef" returned: 0 in 0.831s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:33 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-quobyte-959d37e2-1b7a-416e-9242-4728331709ef" released by "_copy_volume_from_snapshot" :: held 9.911s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:33 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-quobyte-0b8d5d1f-c220-49fb-8864-f1ac4051dcd2-959d37e2-1b7a-416e-9242-4728331709ef" released by "_create_volume_from_snapshot" :: held 9.964s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.987s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:33 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=76,cinder:INSERT=22,cinder:UPDATE=81,cinder:DELETE=5 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:31:33 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:INSERT=27,cinder:UPDATE=92,cinder:SELECT=59,cinder:DELETE=10 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:31:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b59c52-cea5-4595-832d-6ef86630e317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-959d37e2-1b7a-416e-9242-4728331709ef', 'volume_size': 1, 'snapshot_id': '0b8d5d1f-c220-49fb-8864-f1ac4051dcd2'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ac31d8-9754-42b5-ab50-ce78baf43271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:33 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Volume volume-959d37e2-1b7a-416e-9242-4728331709ef (959d37e2-1b7a-416e-9242-4728331709ef): created successfully Jun 15 07:31:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ac31d8-9754-42b5-ab50-ce78baf43271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:33 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Flow 'volume_create_manager' (a78aa490-132b-4872-8b31-964568f16986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:33 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f7620eb0-71af-4416-acc4-975a75b51a14 tempest-SnapshotDependencyTests-1828149333 None] Created volume successfully. Jun 15 07:31:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] Acquiring lock "cinder-0b8d5d1f-c220-49fb-8864-f1ac4051dcd2-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-0b8d5d1f-c220-49fb-8864-f1ac4051dcd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] Acquiring lock "cinder-quobyte-4e932ffe-9c66-486a-9cc1-eba5d9de2b62" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-quobyte-4e932ffe-9c66-486a-9cc1-eba5d9de2b62" acquired by "delete_snapshot" :: waited 0.119s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] Acquiring lock "cinder-quobyte-0b8d5d1f-c220-49fb-8864-f1ac4051dcd2" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-quobyte-0b8d5d1f-c220-49fb-8864-f1ac4051dcd2" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] Deleting offline snapshot 0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 of volume 4e932ffe-9c66-486a-9cc1-eba5d9de2b62 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:31:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] snapshot_file for this snap is: volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:31:34 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee45bd3-18f3-4b23-a1e9-13fe568f5f6f]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:34 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 Jun 15 07:31:34 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:35 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2" returned: 0 in 1.181s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:35 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:31:35 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cd5773-92f5-4460-8f6e-22a20aac5452]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:36 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 Jun 15 07:31:36 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:37 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62" returned: 0 in 1.431s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:37 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 Jun 15 07:31:37 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:38 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2" returned: 0 in 1.221s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:38 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2 Jun 15 07:31:38 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:39 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62.0b8d5d1f-c220-49fb-8864-f1ac4051dcd2" returned: 0 in 1.162s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-quobyte-0b8d5d1f-c220-49fb-8864-f1ac4051dcd2" released by "_delete_snapshot" :: held 5.214s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-quobyte-4e932ffe-9c66-486a-9cc1-eba5d9de2b62" released by "delete_snapshot" :: held 5.270s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:39 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] Created reservations ['a7c79e6e-884a-45fb-a890-e61216f5e4ec', '3ae57f86-4e28-4ff8-92aa-0ec3b75d7b08', '7423fafe-5a9c-4cee-8569-9104f02482ed', '2dcc4d70-c291-4fd5-a702-2b5d3e1f8256'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:40 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] Delete snapshot completed successfully. Jun 15 07:31:40 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-dc4ba471-14ed-4713-9839-536de9af19b3 tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-0b8d5d1f-c220-49fb-8864-f1ac4051dcd2-delete_snapshot" released by "delete_snapshot" :: held 5.733s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] Acquiring lock "cinder-4e932ffe-9c66-486a-9cc1-eba5d9de2b62-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-4e932ffe-9c66-486a-9cc1-eba5d9de2b62-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] Acquiring lock "cinder-quobyte-4e932ffe-9c66-486a-9cc1-eba5d9de2b62" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:41 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-quobyte-4e932ffe-9c66-486a-9cc1-eba5d9de2b62" acquired by "delete_volume" :: waited 0.048s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:41 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[137df985-3a5f-452c-b8ad-0577ef061ba2]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:41 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 Jun 15 07:31:41 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:43 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62" returned: 0 in 1.612s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:43 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62 Jun 15 07:31:43 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:44 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4e932ffe-9c66-486a-9cc1-eba5d9de2b62" returned: 0 in 1.134s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:44 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-quobyte-4e932ffe-9c66-486a-9cc1-eba5d9de2b62" released by "delete_volume" :: held 2.966s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:44 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] Created reservations ['6421ad9e-9015-4604-bcfc-839b8801afb8', '745f8979-d248-4319-a662-18cfb0363c5d', '30a6e18d-e2bc-4738-81cf-e58dd6fac6de', 'af0c3bf5-f142-4838-a34e-d4b3c43805f1'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:44 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:44 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:44 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:31:44 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:44 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] Acquiring lock "cinder-959d37e2-1b7a-416e-9242-4728331709ef-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:44 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-959d37e2-1b7a-416e-9242-4728331709ef-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:44 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] Acquiring lock "cinder-quobyte-959d37e2-1b7a-416e-9242-4728331709ef" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:44 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-quobyte-959d37e2-1b7a-416e-9242-4728331709ef" acquired by "delete_volume" :: waited 0.020s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:45 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a06a09-48e7-4c8c-a8f2-89033bee41ee]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-959d37e2-1b7a-416e-9242-4728331709ef {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:45 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-959d37e2-1b7a-416e-9242-4728331709ef Jun 15 07:31:45 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:45 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.080s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:45 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:31:45 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] Deleted volume successfully. Jun 15 07:31:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-90b38dd2-13c0-4cf3-b3c9-e58d1ba8dd10 tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-4e932ffe-9c66-486a-9cc1-eba5d9de2b62-delete_volume" released by "delete_volume" :: held 4.497s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:46 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-959d37e2-1b7a-416e-9242-4728331709ef" returned: 0 in 1.088s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-959d37e2-1b7a-416e-9242-4728331709ef {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:46 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-959d37e2-1b7a-416e-9242-4728331709ef Jun 15 07:31:46 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:46 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-959d37e2-1b7a-416e-9242-4728331709ef" returned: 0 in 0.610s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-quobyte-959d37e2-1b7a-416e-9242-4728331709ef" released by "delete_volume" :: held 1.769s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:46 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] Created reservations ['d7a07b8a-4fa1-4f97-948a-f1447f437894', '0d4791c2-a0d3-44b5-9ec6-8cb60cdb5abb', 'c3a8f42c-75e4-4604-a88a-95afb65870f5', 'a1a3e512-0388-4beb-a54f-6fe561417856'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:46 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:46 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:46 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:31:46 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:47 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.757s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:47 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:31:47 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] Deleted volume successfully. Jun 15 07:31:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-aa7f3a9e-ed6b-49ae-bf18-e4a8c326235b tempest-SnapshotDependencyTests-1828149333 None] Lock "cinder-959d37e2-1b7a-416e-9242-4728331709ef-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:56 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:UPDATE=23,cinder:DELETE=1,cinder:SELECT=17,cinder:INSERT=6 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:31:58 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:UPDATE=23,cinder:SELECT=15,cinder:INSERT=6,cinder:DELETE=2 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:32:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-d96513be-e7b3-4b3e-83bd-29fd796092ca req-fae99236-6fb0-452e-9df1-58a08ad5b1e6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-d96513be-e7b3-4b3e-83bd-29fd796092ca req-fae99236-6fb0-452e-9df1-58a08ad5b1e6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:07 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4469e4-e854-4713-aad6-e89f4f59e298]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-d96513be-e7b3-4b3e-83bd-29fd796092ca req-fae99236-6fb0-452e-9df1-58a08ad5b1e6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f9305566-0d69-41af-8407-7887220d6d70 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:07 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f9305566-0d69-41af-8407-7887220d6d70 Jun 15 07:32:07 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-0140953b-a5d6-44de-8359-e6dc5fc8aacd req-503ca676-12c9-43e0-a0ef-0387654817ea tempest-TestStampPattern-706242272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:07 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-d96513be-e7b3-4b3e-83bd-29fd796092ca req-fae99236-6fb0-452e-9df1-58a08ad5b1e6 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f9305566-0d69-41af-8407-7887220d6d70" returned: 0 in 0.714s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-d96513be-e7b3-4b3e-83bd-29fd796092ca req-fae99236-6fb0-452e-9df1-58a08ad5b1e6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.734s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-0140953b-a5d6-44de-8359-e6dc5fc8aacd req-503ca676-12c9-43e0-a0ef-0387654817ea tempest-TestStampPattern-706242272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.540s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:07 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de8d37c-e85b-4e35-b726-e3a0f133e5c0]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-0140953b-a5d6-44de-8359-e6dc5fc8aacd req-503ca676-12c9-43e0-a0ef-0387654817ea tempest-TestStampPattern-706242272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-d96513be-e7b3-4b3e-83bd-29fd796092ca req-fae99236-6fb0-452e-9df1-58a08ad5b1e6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-f9305566-0d69-41af-8407-7887220d6d70', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6561c5a-9482-4c45-bcb7-ed4009ddd7bd', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:32:07 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-d96513be-e7b3-4b3e-83bd-29fd796092ca req-fae99236-6fb0-452e-9df1-58a08ad5b1e6 tempest-TestInstancesWithCinderVolumes-1927119799 None] attachment_update completed successfully. Jun 15 07:32:07 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec Jun 15 07:32:07 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:08 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-0140953b-a5d6-44de-8359-e6dc5fc8aacd req-503ca676-12c9-43e0-a0ef-0387654817ea tempest-TestStampPattern-706242272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec" returned: 0 in 0.726s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-0140953b-a5d6-44de-8359-e6dc5fc8aacd req-503ca676-12c9-43e0-a0ef-0387654817ea tempest-TestStampPattern-706242272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.739s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-0140953b-a5d6-44de-8359-e6dc5fc8aacd req-503ca676-12c9-43e0-a0ef-0387654817ea tempest-TestStampPattern-706242272 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-0093b220-68a4-41e2-bb84-78656402ebec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '580233e3-b336-4545-8a2b-f4eba21ddc24', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:32:08 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-0140953b-a5d6-44de-8359-e6dc5fc8aacd req-503ca676-12c9-43e0-a0ef-0387654817ea tempest-TestStampPattern-706242272 None] attachment_update completed successfully. Jun 15 07:32:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:32:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:13 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:32:13 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:14 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.659s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:14 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:32:14 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:32:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 28 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:32:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:32:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-fec06013-aadf-4243-8da5-2521db642bc1 req-9580422e-2b9d-44ce-a1ff-4ab926b2c314 tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-fec06013-aadf-4243-8da5-2521db642bc1 req-9580422e-2b9d-44ce-a1ff-4ab926b2c314 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:15 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5978d873-a0b5-401f-ace8-a08d1e11f006]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-fec06013-aadf-4243-8da5-2521db642bc1 req-9580422e-2b9d-44ce-a1ff-4ab926b2c314 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46fff9d0-3656-4f88-beb0-bd5958862b7f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:15 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46fff9d0-3656-4f88-beb0-bd5958862b7f Jun 15 07:32:15 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:16 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-75650c33-8e7e-4551-b879-1a7eac2a2a80 req-2c4f7585-c606-4289-87aa-21b403b46b96 tempest-TestStampPattern-706242272 None] Terminate volume connection completed successfully. Jun 15 07:32:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-75650c33-8e7e-4551-b879-1a7eac2a2a80 req-2c4f7585-c606-4289-87aa-21b403b46b96 tempest-TestStampPattern-706242272 None] Deleting attachment 580233e3-b336-4545-8a2b-f4eba21ddc24. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:32:16 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-fec06013-aadf-4243-8da5-2521db642bc1 req-9580422e-2b9d-44ce-a1ff-4ab926b2c314 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46fff9d0-3656-4f88-beb0-bd5958862b7f" returned: 0 in 0.819s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-fec06013-aadf-4243-8da5-2521db642bc1 req-9580422e-2b9d-44ce-a1ff-4ab926b2c314 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.843s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-fec06013-aadf-4243-8da5-2521db642bc1 req-9580422e-2b9d-44ce-a1ff-4ab926b2c314 tempest-TestInstancesWithCinderVolumes-1927119799 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-46fff9d0-3656-4f88-beb0-bd5958862b7f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c97d50e-ed23-4073-85a3-20a9dbcbfc90', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:32:16 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-fec06013-aadf-4243-8da5-2521db642bc1 req-9580422e-2b9d-44ce-a1ff-4ab926b2c314 tempest-TestInstancesWithCinderVolumes-1927119799 None] attachment_update completed successfully. Jun 15 07:32:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] Creating offline snapshot fff42ff1-4457-4a5b-a8ab-827e23f385fa of volume 0093b220-68a4-41e2-bb84-78656402ebec {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:32:18 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1432a398-4eaa-4801-ac04-393e45316a4c]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:18 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec Jun 15 07:32:18 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:19 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec" returned: 0 in 0.695s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:19 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa 1G Jun 15 07:32:19 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:20 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa 1G" returned: 0 in 0.752s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0093b220-68a4-41e2-bb84-78656402ebec -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:20 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0093b220-68a4-41e2-bb84-78656402ebec -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa Jun 15 07:32:20 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:20 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0093b220-68a4-41e2-bb84-78656402ebec -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa" returned: 0 in 0.639s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:20 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa is being set with open permissions: ugo+rw Jun 15 07:32:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:20 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa Jun 15 07:32:20 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:21 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa" returned: 0 in 0.633s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:21 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.info Jun 15 07:32:21 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:22 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.info" returned: 0 in 0.639s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:22 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.info is being set with open permissions: ugo+rw Jun 15 07:32:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:22 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.info Jun 15 07:32:22 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:22 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.info" returned: 0 in 0.644s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.088s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:22 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-209ffaf0-4f8a-4af4-b814-5c15239bc2c2 tempest-TestStampPattern-706242272 None] Create snapshot completed successfully Jun 15 07:32:25 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-6d2842bc-a8e3-4930-9c6e-c1fa5a33f556 req-2a529ab5-00b2-4a46-88ee-e685aae8ae8c tempest-TestInstancesWithCinderVolumes-1927119799 None] Terminate volume connection completed successfully. Jun 15 07:32:25 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-6d2842bc-a8e3-4930-9c6e-c1fa5a33f556 req-2a529ab5-00b2-4a46-88ee-e685aae8ae8c tempest-TestInstancesWithCinderVolumes-1927119799 None] Deleting attachment e6561c5a-9482-4c45-bcb7-ed4009ddd7bd. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:32:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "cinder-f9305566-0d69-41af-8407-7887220d6d70-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "cinder-f9305566-0d69-41af-8407-7887220d6d70-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "cinder-quobyte-f9305566-0d69-41af-8407-7887220d6d70" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "cinder-quobyte-f9305566-0d69-41af-8407-7887220d6d70" acquired by "delete_volume" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:27 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[df44979b-e821-4df7-adb1-cca5c26905a1]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f9305566-0d69-41af-8407-7887220d6d70 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:27 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f9305566-0d69-41af-8407-7887220d6d70 Jun 15 07:32:27 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:28 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f9305566-0d69-41af-8407-7887220d6d70" returned: 0 in 0.810s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f9305566-0d69-41af-8407-7887220d6d70 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:28 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f9305566-0d69-41af-8407-7887220d6d70 Jun 15 07:32:28 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:28 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f9305566-0d69-41af-8407-7887220d6d70" returned: 0 in 0.635s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "cinder-quobyte-f9305566-0d69-41af-8407-7887220d6d70" released by "delete_volume" :: held 1.499s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:28 devstack cinder-volume[92129]: WARNING cinder.quota [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1279631112-1781319895 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1279631112-1781319895, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:32:28 devstack cinder-volume[92129]: WARNING cinder.quota [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1279631112-1781319895 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1279631112-1781319895, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:32:29 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Created reservations ['0543cd25-172d-44a2-986e-86eedf1c2179', '20db59f8-a443-4055-9195-f1d7f45fbc45', 'e66f7cf5-e33c-4a48-a590-828b53737a15', '8a3097a2-6392-4b6c-976a-501a569abdbe'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:32:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:29 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:32:29 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:29 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.655s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:29 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:32:29 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Deleted volume successfully. Jun 15 07:32:29 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-016799d2-fa93-4d5c-939a-df2019b97102 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "cinder-f9305566-0d69-41af-8407-7887220d6d70-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:32 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-ba8b0732-f658-4bb4-8a0b-667f04813bbc req-cdebd100-eeb3-4074-8ac4-9b7bc0a81e3d tempest-TestInstancesWithCinderVolumes-1927119799 None] Terminate volume connection completed successfully. Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-ba8b0732-f658-4bb4-8a0b-667f04813bbc req-cdebd100-eeb3-4074-8ac4-9b7bc0a81e3d tempest-TestInstancesWithCinderVolumes-1927119799 None] Deleting attachment 4c97d50e-ed23-4073-85a3-20a9dbcbfc90. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Flow 'volume_create_manager' (a2eabbbb-bd2e-4ccf-b692-1efbfcf525bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74662675-2d27-4e54-9cde-d76adef7a96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74662675-2d27-4e54-9cde-d76adef7a96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-837948450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b023de8-28f6-46a2-ae9b-c9f6606df260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ba99c45fdf4e4e875b1db9ed6a105b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fff42ff1-4457-4a5b-a8ab-827e23f385fa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:32Z,use_quota=True,user_id='4dd0fba840ea40aaa8a93889ff92b626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3f0868-2c77-42d2-a167-6d4179d5ea88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3f0868-2c77-42d2-a167-6d4179d5ea88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1001f886-48a0-45b3-9485-bdc10e66e62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1001f886-48a0-45b3-9485-bdc10e66e62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4b023de8-28f6-46a2-ae9b-c9f6606df260', 'volume_name': 'volume-4b023de8-28f6-46a2-ae9b-c9f6606df260', 'volume_size': 1, 'snapshot_id': 'fff42ff1-4457-4a5b-a8ab-827e23f385fa'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712f1466-81b1-4bee-8b82-6c6dccc4e558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712f1466-81b1-4bee-8b82-6c6dccc4e558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ff7f121-1307-486e-b88c-3592e6e3f561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:32 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Volume 4b023de8-28f6-46a2-ae9b-c9f6606df260: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4b023de8-28f6-46a2-ae9b-c9f6606df260', 'volume_size': 1, 'snapshot_id': 'fff42ff1-4457-4a5b-a8ab-827e23f385fa'} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Acquiring lock "cinder-quobyte-fff42ff1-4457-4a5b-a8ab-827e23f385fa-4b023de8-28f6-46a2-ae9b-c9f6606df260" by "_create_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Lock "cinder-quobyte-fff42ff1-4457-4a5b-a8ab-827e23f385fa-4b023de8-28f6-46a2-ae9b-c9f6606df260" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Creating volume 4b023de8-28f6-46a2-ae9b-c9f6606df260 from snapshot fff42ff1-4457-4a5b-a8ab-827e23f385fa {{(pid=92129) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Acquiring lock "cinder-quobyte-4b023de8-28f6-46a2-ae9b-c9f6606df260" by "_copy_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Lock "cinder-quobyte-4b023de8-28f6-46a2-ae9b-c9f6606df260" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] snapshot: fff42ff1-4457-4a5b-a8ab-827e23f385fa, volume: 4b023de8-28f6-46a2-ae9b-c9f6606df260, {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1104c6b9-3f51-4a7d-9de1-a474130779ba]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:32 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa Jun 15 07:32:32 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:33 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa" returned: 0 in 0.741s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0093b220-68a4-41e2-bb84-78656402ebec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:32:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:32:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Creating direct copy from snapshot {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:32:33 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f28cd0b-98d8-4eb7-97f2-737b7ed3ffe8]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:33 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec Jun 15 07:32:33 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "cinder-46fff9d0-3656-4f88-beb0-bd5958862b7f-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "cinder-46fff9d0-3656-4f88-beb0-bd5958862b7f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "cinder-quobyte-46fff9d0-3656-4f88-beb0-bd5958862b7f" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "cinder-quobyte-46fff9d0-3656-4f88-beb0-bd5958862b7f" acquired by "delete_volume" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:34 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f404ce-9873-413f-9a60-d7ccd87807a6]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46fff9d0-3656-4f88-beb0-bd5958862b7f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:34 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec" returned: 0 in 0.830s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:34 devstack cinder-volume[92129]: DEBUG cinder.utils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Path /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260 not found in is_blk_device check {{(pid=92129) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:32:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:34 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260 Jun 15 07:32:34 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:34 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46fff9d0-3656-4f88-beb0-bd5958862b7f Jun 15 07:32:34 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:35 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46fff9d0-3656-4f88-beb0-bd5958862b7f" returned: 0 in 0.895s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46fff9d0-3656-4f88-beb0-bd5958862b7f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:35 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46fff9d0-3656-4f88-beb0-bd5958862b7f Jun 15 07:32:35 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:36 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46fff9d0-3656-4f88-beb0-bd5958862b7f" returned: 0 in 1.270s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "cinder-quobyte-46fff9d0-3656-4f88-beb0-bd5958862b7f" released by "delete_volume" :: held 2.268s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:36 devstack cinder-volume[92129]: WARNING cinder.quota [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-794505991-1156791449 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-794505991-1156791449, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:32:36 devstack cinder-volume[92129]: WARNING cinder.quota [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-794505991-1156791449 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-794505991-1156791449, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:32:36 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Created reservations ['50ab545f-0952-4d58-a418-ef844aa9351d', 'd65ed929-2c15-4139-b1bf-6bbe3e192242', 'f6e99f94-5e10-46df-aef4-9a1f25e13234', '896fb62d-acc3-4978-b421-ff54e7155838'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:32:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:37 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:32:37 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:39 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 2.167s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:39 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:32:39 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Deleted volume successfully. Jun 15 07:32:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8da809cc-4884-43b8-8a18-54e3874b8783 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "cinder-46fff9d0-3656-4f88-beb0-bd5958862b7f-delete_volume" released by "delete_volume" :: held 5.134s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:40 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260" returned: 0 in 6.408s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:40 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e92db9-7e33-4eda-8285-3a04b6fd05dc]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:41 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec Jun 15 07:32:41 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:42 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec" returned: 0 in 1.332s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:42 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Image conversion details: src /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec, size 1024.00 MB, duration 6.41 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260 {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:32:42 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Converted 1024.00 MB image at 159.77 MB/s Jun 15 07:32:42 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260 is being set with open permissions: ugo+rw Jun 15 07:32:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:42 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260 Jun 15 07:32:42 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:43 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260" returned: 0 in 1.136s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Lock "cinder-quobyte-4b023de8-28f6-46a2-ae9b-c9f6606df260" released by "_copy_volume_from_snapshot" :: held 10.581s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Lock "cinder-quobyte-fff42ff1-4457-4a5b-a8ab-827e23f385fa-4b023de8-28f6-46a2-ae9b-c9f6606df260" released by "_create_volume_from_snapshot" :: held 10.626s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.642s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ff7f121-1307-486e-b88c-3592e6e3f561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b023de8-28f6-46a2-ae9b-c9f6606df260', 'volume_size': 1, 'snapshot_id': 'fff42ff1-4457-4a5b-a8ab-827e23f385fa'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6eb39f-cd26-49e6-a59a-f28aad1f4669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:43 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Volume volume-4b023de8-28f6-46a2-ae9b-c9f6606df260 (4b023de8-28f6-46a2-ae9b-c9f6606df260): created successfully Jun 15 07:32:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6eb39f-cd26-49e6-a59a-f28aad1f4669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Flow 'volume_create_manager' (a2eabbbb-bd2e-4ccf-b692-1efbfcf525bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:43 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-7ca64cff-883b-43fb-9c70-497a2f3fdfbc tempest-TestStampPattern-706242272 None] Created volume successfully. Jun 15 07:32:44 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-a404293b-d3f2-415a-891e-547007ee2b08 req-4636bb2a-fbbb-4814-8616-8e433de3c2b2 tempest-TestInstancesWithCinderVolumes-1927119799 None] Terminate volume connection completed successfully. Jun 15 07:32:44 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-a404293b-d3f2-415a-891e-547007ee2b08 req-4636bb2a-fbbb-4814-8616-8e433de3c2b2 tempest-TestInstancesWithCinderVolumes-1927119799 None] Deleting attachment 7854ea81-afe0-433b-9de0-abde34796f09. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:32:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "cinder-cf24655c-85c0-4f76-9bb2-180f451b1300-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "cinder-cf24655c-85c0-4f76-9bb2-180f451b1300-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "cinder-quobyte-cf24655c-85c0-4f76-9bb2-180f451b1300" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "cinder-quobyte-cf24655c-85c0-4f76-9bb2-180f451b1300" acquired by "delete_volume" :: waited 0.022s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:48 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df185f2-4441-4a71-abdc-5205490052d7]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:48 devstack sudo[108623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 Jun 15 07:32:48 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:49 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300" returned: 0 in 0.770s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:49 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 Jun 15 07:32:49 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:50 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300" returned: 1 in 0.758s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:32:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:50 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300 Jun 15 07:32:50 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:50 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf24655c-85c0-4f76-9bb2-180f451b1300" returned: 0 in 0.667s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "cinder-quobyte-cf24655c-85c0-4f76-9bb2-180f451b1300" released by "delete_volume" :: held 2.294s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:50 devstack cinder-volume[92129]: WARNING cinder.quota [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1591136001-1739039524 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1591136001-1739039524, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:32:50 devstack cinder-volume[92129]: WARNING cinder.quota [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1591136001-1739039524 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1591136001-1739039524, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:32:51 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Created reservations ['0784fabe-7c78-408a-85ed-f6563ce18c4d', 'c991a40f-15c6-4b7e-bc59-2db717681eb7', '04571871-c4a1-4946-80cc-677d9ab78c11', 'a2bb0293-9197-4ba2-8329-7352a60df766'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:32:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:51 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:51 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:51 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:32:51 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:51 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.697s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:51 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:32:51 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Deleted volume successfully. Jun 15 07:32:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0dc11e80-df01-460f-a952-7f49e3ee43c6 tempest-TestInstancesWithCinderVolumes-1927119799 None] Lock "cinder-cf24655c-85c0-4f76-9bb2-180f451b1300-delete_volume" released by "delete_volume" :: held 3.334s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:01 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=35,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=5 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:33:01 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=48,cinder:UPDATE=33,cinder:INSERT=8,cinder:DELETE=3 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:33:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:33:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:13 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:33:13 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:14 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.680s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:14 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:33:14 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:33:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 28 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:33:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:33:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-b5f70b2d-fa80-41d0-bda9-4fdb99557013 req-4b964b62-3038-4873-9cad-7ba19574ec42 tempest-TestStampPattern-706242272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-b5f70b2d-fa80-41d0-bda9-4fdb99557013 req-4b964b62-3038-4873-9cad-7ba19574ec42 tempest-TestStampPattern-706242272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:19 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[980b07cd-a778-41bb-9e4d-e961ef9a8fe8]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-b5f70b2d-fa80-41d0-bda9-4fdb99557013 req-4b964b62-3038-4873-9cad-7ba19574ec42 tempest-TestStampPattern-706242272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:19 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260 Jun 15 07:33:19 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:20 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-b5f70b2d-fa80-41d0-bda9-4fdb99557013 req-4b964b62-3038-4873-9cad-7ba19574ec42 tempest-TestStampPattern-706242272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260" returned: 0 in 0.772s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-b5f70b2d-fa80-41d0-bda9-4fdb99557013 req-4b964b62-3038-4873-9cad-7ba19574ec42 tempest-TestStampPattern-706242272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.795s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:20 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-b5f70b2d-fa80-41d0-bda9-4fdb99557013 req-4b964b62-3038-4873-9cad-7ba19574ec42 tempest-TestStampPattern-706242272 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-4b023de8-28f6-46a2-ae9b-c9f6606df260', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'afcbf13e-fcf5-4844-a77f-8132183efa97', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:33:20 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-b5f70b2d-fa80-41d0-bda9-4fdb99557013 req-4b964b62-3038-4873-9cad-7ba19574ec42 tempest-TestStampPattern-706242272 None] attachment_update completed successfully. Jun 15 07:33:26 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-34678e76-c2ea-4ffe-b1b1-bb677b403e43 req-bda0f577-f1f2-4e0d-88da-86550c27d662 tempest-TestStampPattern-706242272 None] Terminate volume connection completed successfully. Jun 15 07:33:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-34678e76-c2ea-4ffe-b1b1-bb677b403e43 req-bda0f577-f1f2-4e0d-88da-86550c27d662 tempest-TestStampPattern-706242272 None] Deleting attachment afcbf13e-fcf5-4844-a77f-8132183efa97. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:33:30 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:33:36 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:33:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] Acquiring lock "cinder-4b023de8-28f6-46a2-ae9b-c9f6606df260-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] Lock "cinder-4b023de8-28f6-46a2-ae9b-c9f6606df260-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] Acquiring lock "cinder-quobyte-4b023de8-28f6-46a2-ae9b-c9f6606df260" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] Lock "cinder-quobyte-4b023de8-28f6-46a2-ae9b-c9f6606df260" acquired by "delete_volume" :: waited 0.014s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:37 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51efaf2-a9cf-423b-8d57-388c5e2ad5c4]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:37 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260 Jun 15 07:33:37 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:37 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260" returned: 0 in 0.800s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:37 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260 Jun 15 07:33:37 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:38 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4b023de8-28f6-46a2-ae9b-c9f6606df260" returned: 0 in 0.800s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] Lock "cinder-quobyte-4b023de8-28f6-46a2-ae9b-c9f6606df260" released by "delete_volume" :: held 1.645s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:38 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] Created reservations ['7ef0cc4a-948d-43f0-bd65-c9429cf79080', '3904a2ad-04f2-400a-b4e4-1af57688379c', '4933333f-a743-41a9-8bd9-28e1209ed9fa', '620c79b5-c5fc-419b-b7e9-3046beddbaca'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:33:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:38 devstack sudo[109277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:33:38 devstack sudo[109277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:39 devstack sudo[109277]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.736s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:39 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:33:39 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] Deleted volume successfully. Jun 15 07:33:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c9744a2e-e17d-4985-9aad-b59bf243daa8 tempest-TestStampPattern-706242272 None] Lock "cinder-4b023de8-28f6-46a2-ae9b-c9f6606df260-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] Acquiring lock "cinder-fff42ff1-4457-4a5b-a8ab-827e23f385fa-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] Lock "cinder-fff42ff1-4457-4a5b-a8ab-827e23f385fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] Acquiring lock "cinder-quobyte-0093b220-68a4-41e2-bb84-78656402ebec" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] Lock "cinder-quobyte-0093b220-68a4-41e2-bb84-78656402ebec" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] Acquiring lock "cinder-quobyte-fff42ff1-4457-4a5b-a8ab-827e23f385fa" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] Lock "cinder-quobyte-fff42ff1-4457-4a5b-a8ab-827e23f385fa" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] Deleting offline snapshot fff42ff1-4457-4a5b-a8ab-827e23f385fa of volume 0093b220-68a4-41e2-bb84-78656402ebec {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:33:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] snapshot_file for this snap is: volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:33:39 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c259f8b0-deee-4b48-8b8f-c806a99a008f]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:39 devstack sudo[109281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa Jun 15 07:33:39 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:40 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa" returned: 0 in 0.843s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0093b220-68a4-41e2-bb84-78656402ebec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:33:40 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaee5ce0-9ad8-4a4a-9428-9c60ea18ddf9]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:40 devstack sudo[109287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec Jun 15 07:33:40 devstack sudo[109287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:41 devstack sudo[109287]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec" returned: 0 in 0.812s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:41 devstack sudo[109295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa Jun 15 07:33:41 devstack sudo[109295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Flow 'volume_create_manager' (11315da7-f7fd-419e-bbd3-880ddb473e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d013add7-0359-4dfd-81bd-6e86a075c34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d013add7-0359-4dfd-81bd-6e86a075c34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2092141209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b72344-941c-4bd2-be3f-b10ebd567b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b9e311e776475e9f6fbd28284f35e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:33:42Z,use_quota=True,user_id='a60daf7c88794dfbbca8bc865039545d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558298fc-06e8-46bd-b199-640efb14bbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558298fc-06e8-46bd-b199-640efb14bbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc2461e-1427-4250-aed5-6c734091e603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc2461e-1427-4250-aed5-6c734091e603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b72344-941c-4bd2-be3f-b10ebd567b0d', 'volume_name': 'volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e184f8d-3fc0-434d-8b3a-2f5d84ef912a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e184f8d-3fc0-434d-8b3a-2f5d84ef912a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c34107a-1c0b-45b8-8bf2-b0c236dcbbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:41 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Volume b6b72344-941c-4bd2-be3f-b10ebd567b0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d', 'volume_size': 1} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2092141209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b72344-941c-4bd2-be3f-b10ebd567b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b9e311e776475e9f6fbd28284f35e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:33:42Z,use_quota=True,user_id='a60daf7c88794dfbbca8bc865039545d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Creating volume b6b72344-941c-4bd2-be3f-b10ebd567b0d {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:33:41 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:33:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:42 devstack sudo[109297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d 1073741824 Jun 15 07:33:42 devstack sudo[109297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:42 devstack sudo[109295]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa" returned: 0 in 0.833s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:42 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa Jun 15 07:33:42 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:42 devstack sudo[109297]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d 1073741824" returned: 0 in 0.878s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:42 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d Jun 15 07:33:42 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:42 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec.fff42ff1-4457-4a5b-a8ab-827e23f385fa" returned: 0 in 0.629s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] Lock "cinder-quobyte-fff42ff1-4457-4a5b-a8ab-827e23f385fa" released by "_delete_snapshot" :: held 3.244s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] Lock "cinder-quobyte-0093b220-68a4-41e2-bb84-78656402ebec" released by "delete_snapshot" :: held 3.274s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:43 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] Created reservations ['7ad8eb48-0289-4731-a2a1-6a1da873d056', 'bfc14787-d337-4c34-9251-606d5c4c29d9', '2c1134c7-80f8-42f2-8cea-ecb04611a557', 'ba52d5b4-3921-44f6-ae04-9d6e187e68ed'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:33:43 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] Delete snapshot completed successfully. Jun 15 07:33:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-98a103a2-97d6-478d-b9b9-be0e13a04a5f tempest-TestStampPattern-706242272 None] Lock "cinder-fff42ff1-4457-4a5b-a8ab-827e23f385fa-delete_snapshot" released by "delete_snapshot" :: held 3.517s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:43 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d" returned: 0 in 0.683s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:33:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c34107a-1c0b-45b8-8bf2-b0c236dcbbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb32bd86-ff8f-4f1e-8a21-f694de476c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:43 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Volume volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d (b6b72344-941c-4bd2-be3f-b10ebd567b0d): created successfully Jun 15 07:33:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb32bd86-ff8f-4f1e-8a21-f694de476c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:43 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Flow 'volume_create_manager' (11315da7-f7fd-419e-bbd3-880ddb473e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:33:43 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-92ad58fe-e616-4b79-b7cc-109fc7d68f86 tempest-TestMinimumBasicScenario-379813774 None] Created volume successfully. Jun 15 07:33:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-27e2be4f-1d37-403a-81b7-4c71afd44667 req-83c7df98-c02a-49ab-85da-f00915ceb000 tempest-TestMinimumBasicScenario-379813774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-27e2be4f-1d37-403a-81b7-4c71afd44667 req-83c7df98-c02a-49ab-85da-f00915ceb000 tempest-TestMinimumBasicScenario-379813774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:47 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc6a00b-71b2-4e4d-90c2-fa9d3602af2c]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-27e2be4f-1d37-403a-81b7-4c71afd44667 req-83c7df98-c02a-49ab-85da-f00915ceb000 tempest-TestMinimumBasicScenario-379813774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:47 devstack sudo[109398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d Jun 15 07:33:47 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:48 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [req-27e2be4f-1d37-403a-81b7-4c71afd44667 req-83c7df98-c02a-49ab-85da-f00915ceb000 tempest-TestMinimumBasicScenario-379813774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d" returned: 0 in 0.867s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [req-27e2be4f-1d37-403a-81b7-4c71afd44667 req-83c7df98-c02a-49ab-85da-f00915ceb000 tempest-TestMinimumBasicScenario-379813774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.899s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:48 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-27e2be4f-1d37-403a-81b7-4c71afd44667 req-83c7df98-c02a-49ab-85da-f00915ceb000 tempest-TestMinimumBasicScenario-379813774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b', 'name': 'volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e1c512b-8849-4168-881a-bc565cbea8d5', 'enforce_multipath': True} {{(pid=92129) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:33:48 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-27e2be4f-1d37-403a-81b7-4c71afd44667 req-83c7df98-c02a-49ab-85da-f00915ceb000 tempest-TestMinimumBasicScenario-379813774 None] attachment_update completed successfully. Jun 15 07:33:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] Acquiring lock "cinder-0093b220-68a4-41e2-bb84-78656402ebec-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] Lock "cinder-0093b220-68a4-41e2-bb84-78656402ebec-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] Acquiring lock "cinder-quobyte-0093b220-68a4-41e2-bb84-78656402ebec" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] Lock "cinder-quobyte-0093b220-68a4-41e2-bb84-78656402ebec" acquired by "delete_volume" :: waited 0.021s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:51 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda74e20-bad3-4cdb-a5a4-b35935382250]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:51 devstack sudo[109804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec Jun 15 07:33:51 devstack sudo[109804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:52 devstack sudo[109804]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec" returned: 0 in 0.764s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:52 devstack sudo[109810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec Jun 15 07:33:52 devstack sudo[109810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:52 devstack sudo[109810]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0093b220-68a4-41e2-bb84-78656402ebec" returned: 0 in 0.616s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] Lock "cinder-quobyte-0093b220-68a4-41e2-bb84-78656402ebec" released by "delete_volume" :: held 1.434s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:53 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] Created reservations ['3f87602a-02e5-481d-87b6-58c042ecb7cf', 'd4c50d45-d87e-4a3e-8fde-c62e326265aa', 'cdedfc7a-0b7a-4c99-b9c8-d98ba441658c', '798b3839-df89-4546-86b1-c828be079893'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:33:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:53 devstack sudo[109813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:33:53 devstack sudo[109813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:53 devstack sudo[109813]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.605s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:53 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:33:53 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] Deleted volume successfully. Jun 15 07:33:53 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-cd4b8d68-20ea-419b-a118-fc8600ebee28 tempest-TestStampPattern-706242272 None] Lock "cinder-0093b220-68a4-41e2-bb84-78656402ebec-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:03 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=23,cinder:INSERT=5,cinder:UPDATE=22 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:34:03 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=24,cinder:UPDATE=31,cinder:INSERT=8,cinder:DELETE=3 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Flow 'volume_create_manager' (94229ed3-1f64-498f-9077-4c87b161832a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a95ce8-642c-4575-834c-b1dcdaedc18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a95ce8-642c-4575-834c-b1dcdaedc18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-83458525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4cffc36-590e-488a-86b9-e1d5af00138e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa3fe8b021439bbb727c74514fecfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:06Z,use_quota=True,user_id='db38cc9996454ab18a566b8899397c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a6bc51-d167-4238-8c98-f22116a6aeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a6bc51-d167-4238-8c98-f22116a6aeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bbdad04-76c2-434e-a629-25a76d22b4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bbdad04-76c2-434e-a629-25a76d22b4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4cffc36-590e-488a-86b9-e1d5af00138e', 'volume_name': 'volume-f4cffc36-590e-488a-86b9-e1d5af00138e', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48759c06-c129-433c-8c76-ff43433bb5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48759c06-c129-433c-8c76-ff43433bb5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4474692f-b071-4d14-b846-81e08c614e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:06 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Volume f4cffc36-590e-488a-86b9-e1d5af00138e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4cffc36-590e-488a-86b9-e1d5af00138e', 'volume_size': 1} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-83458525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4cffc36-590e-488a-86b9-e1d5af00138e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa3fe8b021439bbb727c74514fecfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:06Z,use_quota=True,user_id='db38cc9996454ab18a566b8899397c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Creating volume f4cffc36-590e-488a-86b9-e1d5af00138e {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:34:06 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4cffc36-590e-488a-86b9-e1d5af00138e 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:06 devstack sudo[109835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4cffc36-590e-488a-86b9-e1d5af00138e 1073741824 Jun 15 07:34:06 devstack sudo[109835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Flow 'volume_create_manager' (2e3e1be3-5b52-4559-ad6d-0fb65265eba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f06db2-a6e5-4533-8ce6-3299c3877c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f06db2-a6e5-4533-8ce6-3299c3877c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-943754983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a61b449-96f4-47ee-9d64-73291c0c3800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa3fe8b021439bbb727c74514fecfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:07Z,use_quota=True,user_id='db38cc9996454ab18a566b8899397c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d911d84a-d9d2-40be-91ff-fd7d34f214c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d911d84a-d9d2-40be-91ff-fd7d34f214c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf1c024-51ab-4e0e-94dc-a6625675edb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf1c024-51ab-4e0e-94dc-a6625675edb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a61b449-96f4-47ee-9d64-73291c0c3800', 'volume_name': 'volume-4a61b449-96f4-47ee-9d64-73291c0c3800', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3f4c97-ad8d-4453-8b05-a2863f2b6e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3f4c97-ad8d-4453-8b05-a2863f2b6e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb59e109-f36a-4705-a7e6-02abe1ddfb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:06 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Volume 4a61b449-96f4-47ee-9d64-73291c0c3800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a61b449-96f4-47ee-9d64-73291c0c3800', 'volume_size': 1} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Flow 'volume_create_manager' (b8412a5e-8293-48fb-a22f-b13a783457db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace93db3-29cf-406f-a232-7ede2ef34e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace93db3-29cf-406f-a232-7ede2ef34e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1889082917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4731ab94-14af-4fbf-80af-aeea68132682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa3fe8b021439bbb727c74514fecfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:07Z,use_quota=True,user_id='db38cc9996454ab18a566b8899397c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad77706-2d4d-4ce7-b52c-fb5b4c4c12cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad77706-2d4d-4ce7-b52c-fb5b4c4c12cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5026980e-6b25-41d9-91dd-ecd9ffb961f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5026980e-6b25-41d9-91dd-ecd9ffb961f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4731ab94-14af-4fbf-80af-aeea68132682', 'volume_name': 'volume-4731ab94-14af-4fbf-80af-aeea68132682', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926aef26-3769-43bf-b28b-97364b34d97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926aef26-3769-43bf-b28b-97364b34d97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e517f9b7-81d2-4d03-bcd2-1981a9463ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:06 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Volume 4731ab94-14af-4fbf-80af-aeea68132682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4731ab94-14af-4fbf-80af-aeea68132682', 'volume_size': 1} Jun 15 07:34:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:07 devstack sudo[109835]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4cffc36-590e-488a-86b9-e1d5af00138e 1073741824" returned: 0 in 0.970s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4cffc36-590e-488a-86b9-e1d5af00138e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:07 devstack sudo[109863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4cffc36-590e-488a-86b9-e1d5af00138e Jun 15 07:34:07 devstack sudo[109863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Flow 'volume_create_manager' (d7c182c3-a70b-4431-aeb2-51b67b26b868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9640fd-b597-4d4e-8b69-7a479b1f6f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9640fd-b597-4d4e-8b69-7a479b1f6f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1035054998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0679752-c4ca-43cd-997b-0706f5ca02c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa3fe8b021439bbb727c74514fecfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:07Z,use_quota=True,user_id='db38cc9996454ab18a566b8899397c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9591f41c-9dc3-4145-9c0d-e8efc8140e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9591f41c-9dc3-4145-9c0d-e8efc8140e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85acd1b-9f5d-442d-8d00-451732a16fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85acd1b-9f5d-442d-8d00-451732a16fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0679752-c4ca-43cd-997b-0706f5ca02c1', 'volume_name': 'volume-f0679752-c4ca-43cd-997b-0706f5ca02c1', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b5831a-b2f6-48f1-8f0c-50c9bfc3d900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b5831a-b2f6-48f1-8f0c-50c9bfc3d900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade65e8a-cf62-40f9-a484-7affdda4bb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:07 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Volume f0679752-c4ca-43cd-997b-0706f5ca02c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0679752-c4ca-43cd-997b-0706f5ca02c1', 'volume_size': 1} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Flow 'volume_create_manager' (535e1443-1731-4bc0-bcc6-85d05c3840e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4897e802-93b6-43fc-8778-23db674e489b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4897e802-93b6-43fc-8778-23db674e489b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-384594510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d977fe-20e2-4403-a2e5-5403d2a8d7de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa3fe8b021439bbb727c74514fecfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:08Z,use_quota=True,user_id='db38cc9996454ab18a566b8899397c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d141b86b-6fdb-483f-9927-755a8306b108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d141b86b-6fdb-483f-9927-755a8306b108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4de234-fc08-4628-bbc2-1a0e6b36ac4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4de234-fc08-4628-bbc2-1a0e6b36ac4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28d977fe-20e2-4403-a2e5-5403d2a8d7de', 'volume_name': 'volume-28d977fe-20e2-4403-a2e5-5403d2a8d7de', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc23daaa-fa17-43f4-b9f3-2e575914f8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc23daaa-fa17-43f4-b9f3-2e575914f8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b6c76f-6e38-4516-aff5-ae721a9f19c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:07 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Volume 28d977fe-20e2-4403-a2e5-5403d2a8d7de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28d977fe-20e2-4403-a2e5-5403d2a8d7de', 'volume_size': 1} Jun 15 07:34:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:08 devstack sudo[109863]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4cffc36-590e-488a-86b9-e1d5af00138e" returned: 0 in 0.889s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:34:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.638s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-943754983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a61b449-96f4-47ee-9d64-73291c0c3800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa3fe8b021439bbb727c74514fecfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:07Z,use_quota=True,user_id='db38cc9996454ab18a566b8899397c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:34:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Creating volume 4a61b449-96f4-47ee-9d64-73291c0c3800 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:34:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:34:08 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:34:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a61b449-96f4-47ee-9d64-73291c0c3800 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:08 devstack sudo[109902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a61b449-96f4-47ee-9d64-73291c0c3800 1073741824 Jun 15 07:34:08 devstack sudo[109902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4474692f-b071-4d14-b846-81e08c614e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4cffc36-590e-488a-86b9-e1d5af00138e', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee1a1af-aa1d-4808-8985-e39c02018f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:08 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Volume volume-f4cffc36-590e-488a-86b9-e1d5af00138e (f4cffc36-590e-488a-86b9-e1d5af00138e): created successfully Jun 15 07:34:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee1a1af-aa1d-4808-8985-e39c02018f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Flow 'volume_create_manager' (94229ed3-1f64-498f-9077-4c87b161832a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:08 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-ba9c2db1-d1f4-4772-a05a-ca245644e93e tempest-CreateVolumesFromImageTest-1345047378 None] Created volume successfully. Jun 15 07:34:09 devstack sudo[109902]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a61b449-96f4-47ee-9d64-73291c0c3800 1073741824" returned: 0 in 1.147s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a61b449-96f4-47ee-9d64-73291c0c3800 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:09 devstack sudo[109975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a61b449-96f4-47ee-9d64-73291c0c3800 Jun 15 07:34:09 devstack sudo[109975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:10 devstack sudo[109975]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a61b449-96f4-47ee-9d64-73291c0c3800" returned: 0 in 0.664s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:10 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:34:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.162s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:10 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1889082917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4731ab94-14af-4fbf-80af-aeea68132682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa3fe8b021439bbb727c74514fecfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:07Z,use_quota=True,user_id='db38cc9996454ab18a566b8899397c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:34:10 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Creating volume 4731ab94-14af-4fbf-80af-aeea68132682 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:34:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:10 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:10 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:10 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:34:10 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:34:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4731ab94-14af-4fbf-80af-aeea68132682 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:10 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb59e109-f36a-4705-a7e6-02abe1ddfb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a61b449-96f4-47ee-9d64-73291c0c3800', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:10 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b9f341-fab2-488f-8ea6-2bfc0f71996a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:10 devstack sudo[109980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4731ab94-14af-4fbf-80af-aeea68132682 1073741824 Jun 15 07:34:10 devstack sudo[109980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:10 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Volume volume-4a61b449-96f4-47ee-9d64-73291c0c3800 (4a61b449-96f4-47ee-9d64-73291c0c3800): created successfully Jun 15 07:34:10 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b9f341-fab2-488f-8ea6-2bfc0f71996a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:10 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Flow 'volume_create_manager' (2e3e1be3-5b52-4559-ad6d-0fb65265eba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:10 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-a9fa1f39-1f29-4e68-b6f0-753f2bdadbb2 tempest-CreateVolumesFromImageTest-1345047378 None] Created volume successfully. Jun 15 07:34:11 devstack sudo[109980]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4731ab94-14af-4fbf-80af-aeea68132682 1073741824" returned: 0 in 0.892s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4731ab94-14af-4fbf-80af-aeea68132682 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:11 devstack sudo[109986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4731ab94-14af-4fbf-80af-aeea68132682 Jun 15 07:34:11 devstack sudo[109986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:11 devstack sudo[109986]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4731ab94-14af-4fbf-80af-aeea68132682" returned: 0 in 0.644s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.070s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1035054998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0679752-c4ca-43cd-997b-0706f5ca02c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa3fe8b021439bbb727c74514fecfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:07Z,use_quota=True,user_id='db38cc9996454ab18a566b8899397c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Creating volume f0679752-c4ca-43cd-997b-0706f5ca02c1 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:34:11 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f0679752-c4ca-43cd-997b-0706f5ca02c1 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:11 devstack sudo[109989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f0679752-c4ca-43cd-997b-0706f5ca02c1 1073741824 Jun 15 07:34:11 devstack sudo[109989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e517f9b7-81d2-4d03-bcd2-1981a9463ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4731ab94-14af-4fbf-80af-aeea68132682', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b135e9-38e0-4291-9a21-6c9af25815b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:11 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Volume volume-4731ab94-14af-4fbf-80af-aeea68132682 (4731ab94-14af-4fbf-80af-aeea68132682): created successfully Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b135e9-38e0-4291-9a21-6c9af25815b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Flow 'volume_create_manager' (b8412a5e-8293-48fb-a22f-b13a783457db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:11 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-6113c05f-1e17-4d9e-a9d8-4ad5d3277644 tempest-CreateVolumesFromImageTest-1345047378 None] Created volume successfully. Jun 15 07:34:12 devstack sudo[109989]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f0679752-c4ca-43cd-997b-0706f5ca02c1 1073741824" returned: 0 in 0.832s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f0679752-c4ca-43cd-997b-0706f5ca02c1 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:12 devstack sudo[109994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f0679752-c4ca-43cd-997b-0706f5ca02c1 Jun 15 07:34:12 devstack sudo[109994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:13 devstack sudo[109994]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f0679752-c4ca-43cd-997b-0706f5ca02c1" returned: 0 in 0.648s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.289s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-384594510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d977fe-20e2-4403-a2e5-5403d2a8d7de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa3fe8b021439bbb727c74514fecfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:08Z,use_quota=True,user_id='db38cc9996454ab18a566b8899397c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Creating volume 28d977fe-20e2-4403-a2e5-5403d2a8d7de {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:34:13 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-28d977fe-20e2-4403-a2e5-5403d2a8d7de 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade65e8a-cf62-40f9-a484-7affdda4bb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0679752-c4ca-43cd-997b-0706f5ca02c1', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:13 devstack sudo[109997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-28d977fe-20e2-4403-a2e5-5403d2a8d7de 1073741824 Jun 15 07:34:13 devstack sudo[109997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f05847-901e-43c7-9fd1-d79a3e5e0179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:13 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Volume volume-f0679752-c4ca-43cd-997b-0706f5ca02c1 (f0679752-c4ca-43cd-997b-0706f5ca02c1): created successfully Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f05847-901e-43c7-9fd1-d79a3e5e0179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Flow 'volume_create_manager' (d7c182c3-a70b-4431-aeb2-51b67b26b868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:13 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-69e75bfe-d2d1-475c-a3cb-fbe2b327a387 tempest-CreateVolumesFromImageTest-1345047378 None] Created volume successfully. Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:13 devstack sudo[110002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:34:13 devstack sudo[110002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:14 devstack sudo[109997]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-28d977fe-20e2-4403-a2e5-5403d2a8d7de 1073741824" returned: 0 in 0.811s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-28d977fe-20e2-4403-a2e5-5403d2a8d7de {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:14 devstack sudo[110004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-28d977fe-20e2-4403-a2e5-5403d2a8d7de Jun 15 07:34:14 devstack sudo[110004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:14 devstack sudo[110002]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.714s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:14 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:34:14 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:34:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 28 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:34:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:34:14 devstack sudo[110004]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-28d977fe-20e2-4403-a2e5-5403d2a8d7de" returned: 0 in 0.647s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:14 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:34:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b6c76f-6e38-4516-aff5-ae721a9f19c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28d977fe-20e2-4403-a2e5-5403d2a8d7de', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322b9ff2-e625-459b-8b67-4bfd21a66c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:14 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Volume volume-28d977fe-20e2-4403-a2e5-5403d2a8d7de (28d977fe-20e2-4403-a2e5-5403d2a8d7de): created successfully Jun 15 07:34:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322b9ff2-e625-459b-8b67-4bfd21a66c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Flow 'volume_create_manager' (535e1443-1731-4bc0-bcc6-85d05c3840e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:14 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-95519686-b656-40c2-a0f4-eaa57db0cf68 tempest-CreateVolumesFromImageTest-1345047378 None] Created volume successfully. Jun 15 07:34:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "cinder-28d977fe-20e2-4403-a2e5-5403d2a8d7de-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-28d977fe-20e2-4403-a2e5-5403d2a8d7de-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "cinder-quobyte-28d977fe-20e2-4403-a2e5-5403d2a8d7de" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-quobyte-28d977fe-20e2-4403-a2e5-5403d2a8d7de" acquired by "delete_volume" :: waited 0.021s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:15 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c455bfd8-f30a-4862-a763-5c1521620cc3]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-28d977fe-20e2-4403-a2e5-5403d2a8d7de {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:15 devstack sudo[110008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-28d977fe-20e2-4403-a2e5-5403d2a8d7de Jun 15 07:34:15 devstack sudo[110008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:16 devstack sudo[110008]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-28d977fe-20e2-4403-a2e5-5403d2a8d7de" returned: 0 in 0.727s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-28d977fe-20e2-4403-a2e5-5403d2a8d7de {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:16 devstack sudo[110013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-28d977fe-20e2-4403-a2e5-5403d2a8d7de Jun 15 07:34:16 devstack sudo[110013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:17 devstack sudo[110013]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-28d977fe-20e2-4403-a2e5-5403d2a8d7de" returned: 0 in 0.620s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-quobyte-28d977fe-20e2-4403-a2e5-5403d2a8d7de" released by "delete_volume" :: held 1.393s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:17 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] Created reservations ['2e15015e-4a6e-4458-a2d0-0352f1a8bef6', '5031483d-88ff-40bf-9648-766988a8fd76', '2ca70e4b-f3c5-487e-8587-58c988ddd16f', 'bfb78291-be4d-4e4e-bcc6-398593d99d58'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:34:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:17 devstack sudo[110016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:34:17 devstack sudo[110016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:18 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "cinder-f0679752-c4ca-43cd-997b-0706f5ca02c1-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:18 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-f0679752-c4ca-43cd-997b-0706f5ca02c1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:18 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "cinder-quobyte-f0679752-c4ca-43cd-997b-0706f5ca02c1" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:18 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-quobyte-f0679752-c4ca-43cd-997b-0706f5ca02c1" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:18 devstack sudo[110016]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.736s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:18 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:34:18 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] Deleted volume successfully. Jun 15 07:34:18 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7b5c1f-6b24-4de5-9a7b-b36afe8c051b]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f0679752-c4ca-43cd-997b-0706f5ca02c1 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:18 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-771ccb98-9406-415f-b91f-632484bef88e tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-28d977fe-20e2-4403-a2e5-5403d2a8d7de-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:18 devstack sudo[110019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f0679752-c4ca-43cd-997b-0706f5ca02c1 Jun 15 07:34:18 devstack sudo[110019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:18 devstack sudo[110019]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f0679752-c4ca-43cd-997b-0706f5ca02c1" returned: 0 in 0.753s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f0679752-c4ca-43cd-997b-0706f5ca02c1 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:18 devstack sudo[110024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f0679752-c4ca-43cd-997b-0706f5ca02c1 Jun 15 07:34:18 devstack sudo[110024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:19 devstack sudo[110024]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f0679752-c4ca-43cd-997b-0706f5ca02c1" returned: 0 in 0.623s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-quobyte-f0679752-c4ca-43cd-997b-0706f5ca02c1" released by "delete_volume" :: held 1.425s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:19 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] Created reservations ['a830fa7b-1bb9-4b1a-afe5-b3790a7ee855', 'ab650652-316e-46cd-ae74-d7fccbad680c', 'a7031ef2-e663-4cd4-8591-861838110de9', '4e400ed1-3311-47df-a6e2-86a01b503d03'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:34:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:19 devstack sudo[110027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:34:19 devstack sudo[110027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "cinder-4731ab94-14af-4fbf-80af-aeea68132682-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-4731ab94-14af-4fbf-80af-aeea68132682-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:20 devstack sudo[110027]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.717s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:20 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:34:20 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] Deleted volume successfully. Jun 15 07:34:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "cinder-quobyte-4731ab94-14af-4fbf-80af-aeea68132682" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-09df651b-3ae7-4800-bd92-9e9dae921092 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-f0679752-c4ca-43cd-997b-0706f5ca02c1-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-quobyte-4731ab94-14af-4fbf-80af-aeea68132682" acquired by "delete_volume" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:20 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d653d956-47cc-4056-9aad-a373298c1dec]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4731ab94-14af-4fbf-80af-aeea68132682 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:20 devstack sudo[110031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4731ab94-14af-4fbf-80af-aeea68132682 Jun 15 07:34:20 devstack sudo[110031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:21 devstack sudo[110031]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4731ab94-14af-4fbf-80af-aeea68132682" returned: 0 in 0.781s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4731ab94-14af-4fbf-80af-aeea68132682 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:21 devstack sudo[110036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4731ab94-14af-4fbf-80af-aeea68132682 Jun 15 07:34:21 devstack sudo[110036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:21 devstack sudo[110036]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4731ab94-14af-4fbf-80af-aeea68132682" returned: 0 in 0.658s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-quobyte-4731ab94-14af-4fbf-80af-aeea68132682" released by "delete_volume" :: held 1.483s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:21 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] Created reservations ['69e19305-8099-4dae-b9a1-4ce8e2009646', 'aec15be8-1c27-47ac-ac7e-324d13b6f9d4', '731e8470-3531-4e82-984c-3f8ceeb230af', '639760ec-22ba-423e-8295-fe1b724d42e1'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:34:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:22 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:22 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:22 devstack sudo[110043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:34:22 devstack sudo[110043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "cinder-4a61b449-96f4-47ee-9d64-73291c0c3800-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-4a61b449-96f4-47ee-9d64-73291c0c3800-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "cinder-quobyte-4a61b449-96f4-47ee-9d64-73291c0c3800" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-quobyte-4a61b449-96f4-47ee-9d64-73291c0c3800" acquired by "delete_volume" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:22 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc6f685-667a-4253-833e-2f58d2082024]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a61b449-96f4-47ee-9d64-73291c0c3800 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:22 devstack sudo[110043]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.718s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:22 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:34:22 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] Deleted volume successfully. Jun 15 07:34:22 devstack sudo[110046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a61b449-96f4-47ee-9d64-73291c0c3800 Jun 15 07:34:22 devstack sudo[110046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1c349d7b-3cfe-45d8-8738-b66c1fff5589 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-4731ab94-14af-4fbf-80af-aeea68132682-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:23 devstack sudo[110046]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a61b449-96f4-47ee-9d64-73291c0c3800" returned: 0 in 0.714s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a61b449-96f4-47ee-9d64-73291c0c3800 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:23 devstack sudo[110051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a61b449-96f4-47ee-9d64-73291c0c3800 Jun 15 07:34:23 devstack sudo[110051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:24 devstack sudo[110051]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a61b449-96f4-47ee-9d64-73291c0c3800" returned: 0 in 0.642s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-quobyte-4a61b449-96f4-47ee-9d64-73291c0c3800" released by "delete_volume" :: held 1.401s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] Created reservations ['d5b1986a-0524-4895-b222-e24959050a0c', '1037d576-2638-4c08-9536-3e2e95290b15', '4a563a0a-3f6d-475e-a54c-9aca594902ad', '27b426b2-cdef-43eb-822f-fef3e95b0d3a'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:24 devstack sudo[110060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:34:24 devstack sudo[110060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "cinder-f4cffc36-590e-488a-86b9-e1d5af00138e-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:24 devstack sudo[110060]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.645s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-f4cffc36-590e-488a-86b9-e1d5af00138e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:24 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] Deleted volume successfully. Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b4fc5c0c-8d8e-426d-be4e-530d10576822 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-4a61b449-96f4-47ee-9d64-73291c0c3800-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "cinder-quobyte-f4cffc36-590e-488a-86b9-e1d5af00138e" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-quobyte-f4cffc36-590e-488a-86b9-e1d5af00138e" acquired by "delete_volume" :: waited 0.016s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8ac2a5-2f96-461d-96fd-fc3674e80439]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4cffc36-590e-488a-86b9-e1d5af00138e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:25 devstack sudo[110063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4cffc36-590e-488a-86b9-e1d5af00138e Jun 15 07:34:25 devstack sudo[110063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:25 devstack sudo[110063]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4cffc36-590e-488a-86b9-e1d5af00138e" returned: 0 in 0.738s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4cffc36-590e-488a-86b9-e1d5af00138e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:25 devstack sudo[110068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4cffc36-590e-488a-86b9-e1d5af00138e Jun 15 07:34:25 devstack sudo[110068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:26 devstack sudo[110068]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4cffc36-590e-488a-86b9-e1d5af00138e" returned: 0 in 0.630s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-quobyte-f4cffc36-590e-488a-86b9-e1d5af00138e" released by "delete_volume" :: held 1.408s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:26 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] Created reservations ['c0d074bf-45ae-405f-981b-9f8c48459e5c', 'aec4de01-6356-4ba3-b0c0-af82a89877f9', '2785e4f0-14ec-47c3-b494-2e18f2cec014', '28c7679c-b99a-4f57-a791-f6187e14bcd1'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:34:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:26 devstack sudo[110071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:34:26 devstack sudo[110071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:27 devstack sudo[110071]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.619s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:27 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:34:27 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] Deleted volume successfully. Jun 15 07:34:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-19cc5c57-b912-4959-9899-2e14fc7cb0d4 tempest-CreateVolumesFromImageTest-1345047378 None] Lock "cinder-f4cffc36-590e-488a-86b9-e1d5af00138e-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:29 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Flow 'volume_create_manager' (833a5577-fc1c-4505-b5c3-c94bbfe75ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf3e40e-6a9c-48d1-a14a-7b46c31864af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf3e40e-6a9c-48d1-a14a-7b46c31864af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2092801307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11cd628-c032-467a-9716-ddaccdfb1b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbbaa52d5f74ca1b56d13588158edc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:30Z,use_quota=True,user_id='2970793ec876445abd11ad855bbc4f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26b852e-edd9-495b-93b8-de28e3e8f51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26b852e-edd9-495b-93b8-de28e3e8f51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7705638-4b93-4d5d-9bc9-c27d8a0d4d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7705638-4b93-4d5d-9bc9-c27d8a0d4d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f11cd628-c032-467a-9716-ddaccdfb1b28', 'volume_name': 'volume-f11cd628-c032-467a-9716-ddaccdfb1b28', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:29 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dae65c4-1489-4063-95d8-9c97c21d85e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dae65c4-1489-4063-95d8-9c97c21d85e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:30 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235ed7f0-1e24-4f7e-9cb6-a918a9d3b6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:30 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Volume f11cd628-c032-467a-9716-ddaccdfb1b28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f11cd628-c032-467a-9716-ddaccdfb1b28', 'volume_size': 1} Jun 15 07:34:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2092801307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11cd628-c032-467a-9716-ddaccdfb1b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbbaa52d5f74ca1b56d13588158edc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:30Z,use_quota=True,user_id='2970793ec876445abd11ad855bbc4f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:34:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Creating volume f11cd628-c032-467a-9716-ddaccdfb1b28 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:34:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:34:30 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:34:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:30 devstack sudo[110075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 1073741824 Jun 15 07:34:30 devstack sudo[110075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:30 devstack sudo[110075]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 1073741824" returned: 0 in 0.816s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:30 devstack sudo[110085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 Jun 15 07:34:30 devstack sudo[110085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:31 devstack sudo[110085]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28" returned: 0 in 0.656s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:34:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235ed7f0-1e24-4f7e-9cb6-a918a9d3b6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f11cd628-c032-467a-9716-ddaccdfb1b28', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0c0715-f454-4f8f-baf6-d66c960f1676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:31 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Volume volume-f11cd628-c032-467a-9716-ddaccdfb1b28 (f11cd628-c032-467a-9716-ddaccdfb1b28): created successfully Jun 15 07:34:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0c0715-f454-4f8f-baf6-d66c960f1676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:31 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Flow 'volume_create_manager' (833a5577-fc1c-4505-b5c3-c94bbfe75ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:31 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-5d597cf6-aec4-4a85-90a5-bbaa604f7e56 tempest-VolumeDependencyTests-1398716412 None] Created volume successfully. Jun 15 07:34:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] Creating offline snapshot 16289ec2-121f-4c6a-b42e-25ada671a601 of volume f11cd628-c032-467a-9716-ddaccdfb1b28 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:34:32 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5082cd59-0d24-46db-9fdd-b4392ebf407c]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:32 devstack sudo[110089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 Jun 15 07:34:32 devstack sudo[110089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:33 devstack sudo[110089]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28" returned: 0 in 0.749s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:33 devstack sudo[110096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601 1G Jun 15 07:34:33 devstack sudo[110096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:33 devstack sudo[110096]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601 1G" returned: 0 in 0.758s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f11cd628-c032-467a-9716-ddaccdfb1b28 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:33 devstack sudo[110103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f11cd628-c032-467a-9716-ddaccdfb1b28 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601 Jun 15 07:34:33 devstack sudo[110103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:34 devstack cinder-volume[92129]: INFO cinder.volume.manager [req-07dda6a5-fecd-4bef-ae2d-e40064a75f14 req-0fed0e4d-6e11-489d-bc8a-0ccf100512d1 tempest-TestMinimumBasicScenario-379813774 None] Terminate volume connection completed successfully. Jun 15 07:34:34 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [req-07dda6a5-fecd-4bef-ae2d-e40064a75f14 req-0fed0e4d-6e11-489d-bc8a-0ccf100512d1 tempest-TestMinimumBasicScenario-379813774 None] Deleting attachment 7e1c512b-8849-4168-881a-bc565cbea8d5. {{(pid=92129) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:34:34 devstack sudo[110103]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f11cd628-c032-467a-9716-ddaccdfb1b28 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601" returned: 0 in 0.685s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:34 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601 is being set with open permissions: ugo+rw Jun 15 07:34:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:34 devstack sudo[110111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601 Jun 15 07:34:34 devstack sudo[110111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:35 devstack sudo[110111]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601" returned: 0 in 0.589s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:35 devstack sudo[110114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.info Jun 15 07:34:35 devstack sudo[110114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:35 devstack sudo[110114]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.info" returned: 0 in 0.600s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:35 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.info is being set with open permissions: ugo+rw Jun 15 07:34:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:35 devstack sudo[110117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.info Jun 15 07:34:35 devstack sudo[110117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] Acquiring lock "cinder-b6b72344-941c-4bd2-be3f-b10ebd567b0d-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] Lock "cinder-b6b72344-941c-4bd2-be3f-b10ebd567b0d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] Acquiring lock "cinder-quobyte-b6b72344-941c-4bd2-be3f-b10ebd567b0d" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:36 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] Lock "cinder-quobyte-b6b72344-941c-4bd2-be3f-b10ebd567b0d" acquired by "delete_volume" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:36 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fda53f5-9ae9-48d0-98fd-868efd4de8d2]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:36 devstack sudo[110117]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.info" returned: 0 in 0.635s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:36 devstack sudo[110120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d Jun 15 07:34:36 devstack sudo[110120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.129s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:36 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-d6b82df3-2956-4828-ae97-9f37abb09fe8 tempest-VolumeDependencyTests-1398716412 None] Create snapshot completed successfully Jun 15 07:34:36 devstack sudo[110120]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d" returned: 0 in 0.709s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:37 devstack sudo[110125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d Jun 15 07:34:37 devstack sudo[110125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:37 devstack sudo[110125]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b6b72344-941c-4bd2-be3f-b10ebd567b0d" returned: 0 in 0.619s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] Lock "cinder-quobyte-b6b72344-941c-4bd2-be3f-b10ebd567b0d" released by "delete_volume" :: held 1.370s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:37 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] Created reservations ['32aa8238-1443-4cf2-b47c-be400cf9d6ba', '13558ca7-ce56-4c7a-8d51-582634976f7b', '34516db7-dd2c-4a81-aee4-639d1d1e10ba', '33fff6d3-941b-4fd2-a752-b3a50336a533'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:34:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:37 devstack sudo[110128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:34:37 devstack sudo[110128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:37 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:37 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Flow 'volume_create_manager' (ab7bf62e-6129-40ed-b0c2-7896acddde07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066b9efb-7fbb-482d-91fa-fa68fe0dbbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066b9efb-7fbb-482d-91fa-fa68fe0dbbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-253754626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a2f9154-97b3-41bd-b93d-e44dddd56912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbbaa52d5f74ca1b56d13588158edc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=16289ec2-121f-4c6a-b42e-25ada671a601,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:38Z,use_quota=True,user_id='2970793ec876445abd11ad855bbc4f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2ae5a6-da55-4681-926d-b5d12e054e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2ae5a6-da55-4681-926d-b5d12e054e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a65d8f0-a70a-4224-b353-8e3bebadbed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a65d8f0-a70a-4224-b353-8e3bebadbed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4a2f9154-97b3-41bd-b93d-e44dddd56912', 'volume_name': 'volume-4a2f9154-97b3-41bd-b93d-e44dddd56912', 'volume_size': 1, 'snapshot_id': '16289ec2-121f-4c6a-b42e-25ada671a601'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a984b8a8-4a2c-4f9f-b0a9-27c8ed8300d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a984b8a8-4a2c-4f9f-b0a9-27c8ed8300d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc0581b-aca6-4719-a06f-30f61b6cd944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:38 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Volume 4a2f9154-97b3-41bd-b93d-e44dddd56912: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4a2f9154-97b3-41bd-b93d-e44dddd56912', 'volume_size': 1, 'snapshot_id': '16289ec2-121f-4c6a-b42e-25ada671a601'} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Acquiring lock "cinder-quobyte-16289ec2-121f-4c6a-b42e-25ada671a601-4a2f9154-97b3-41bd-b93d-e44dddd56912" by "_create_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-quobyte-16289ec2-121f-4c6a-b42e-25ada671a601-4a2f9154-97b3-41bd-b93d-e44dddd56912" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Creating volume 4a2f9154-97b3-41bd-b93d-e44dddd56912 from snapshot 16289ec2-121f-4c6a-b42e-25ada671a601 {{(pid=92129) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Acquiring lock "cinder-quobyte-4a2f9154-97b3-41bd-b93d-e44dddd56912" by "_copy_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-quobyte-4a2f9154-97b3-41bd-b93d-e44dddd56912" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] snapshot: 16289ec2-121f-4c6a-b42e-25ada671a601, volume: 4a2f9154-97b3-41bd-b93d-e44dddd56912, {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91a33f8-6508-4910-88a7-c4e026273c22]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:38 devstack sudo[110130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601 Jun 15 07:34:38 devstack sudo[110130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:38 devstack sudo[110128]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.670s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:34:38 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] Deleted volume successfully. Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c8e627b9-2f05-4d20-ae5a-09f5b47f50de tempest-TestMinimumBasicScenario-379813774 None] Lock "cinder-b6b72344-941c-4bd2-be3f-b10ebd567b0d-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:38 devstack sudo[110130]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601" returned: 0 in 0.728s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f11cd628-c032-467a-9716-ddaccdfb1b28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Creating direct copy from snapshot {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03605e8-5f6c-478c-b71b-5e81f0b6d30b]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:39 devstack sudo[110137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 Jun 15 07:34:39 devstack sudo[110137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:39 devstack sudo[110137]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28" returned: 0 in 0.801s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:39 devstack cinder-volume[92129]: DEBUG cinder.utils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Path /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a2f9154-97b3-41bd-b93d-e44dddd56912 not found in is_blk_device check {{(pid=92129) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:34:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a2f9154-97b3-41bd-b93d-e44dddd56912 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:39 devstack sudo[110164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a2f9154-97b3-41bd-b93d-e44dddd56912 Jun 15 07:34:39 devstack sudo[110164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:44 devstack sudo[110164]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a2f9154-97b3-41bd-b93d-e44dddd56912" returned: 0 in 5.108s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:44 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7e3025-2fac-475f-8d6b-7f352a66c7db]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:44 devstack sudo[110237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 Jun 15 07:34:44 devstack sudo[110237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:45 devstack sudo[110237]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28" returned: 0 in 0.889s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:45 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Image conversion details: src /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a2f9154-97b3-41bd-b93d-e44dddd56912 {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:34:45 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Converted 1024.00 MB image at 200.42 MB/s Jun 15 07:34:45 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a2f9154-97b3-41bd-b93d-e44dddd56912 is being set with open permissions: ugo+rw Jun 15 07:34:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a2f9154-97b3-41bd-b93d-e44dddd56912 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:45 devstack sudo[110242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a2f9154-97b3-41bd-b93d-e44dddd56912 Jun 15 07:34:45 devstack sudo[110242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:46 devstack sudo[110242]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a2f9154-97b3-41bd-b93d-e44dddd56912" returned: 0 in 0.597s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-quobyte-4a2f9154-97b3-41bd-b93d-e44dddd56912" released by "_copy_volume_from_snapshot" :: held 8.235s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-quobyte-16289ec2-121f-4c6a-b42e-25ada671a601-4a2f9154-97b3-41bd-b93d-e44dddd56912" released by "_create_volume_from_snapshot" :: held 8.272s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.289s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc0581b-aca6-4719-a06f-30f61b6cd944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a2f9154-97b3-41bd-b93d-e44dddd56912', 'volume_size': 1, 'snapshot_id': '16289ec2-121f-4c6a-b42e-25ada671a601'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d8c5a3-e1f4-4f28-9ef3-81af2cbe3183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:46 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Volume volume-4a2f9154-97b3-41bd-b93d-e44dddd56912 (4a2f9154-97b3-41bd-b93d-e44dddd56912): created successfully Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d8c5a3-e1f4-4f28-9ef3-81af2cbe3183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Flow 'volume_create_manager' (ab7bf62e-6129-40ed-b0c2-7896acddde07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:46 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0ed00536-17a2-42a8-8e12-4d6ede82e9a7 tempest-VolumeDependencyTests-1398716412 None] Created volume successfully. Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] Acquiring lock "cinder-16289ec2-121f-4c6a-b42e-25ada671a601-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-16289ec2-121f-4c6a-b42e-25ada671a601-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] Acquiring lock "cinder-quobyte-f11cd628-c032-467a-9716-ddaccdfb1b28" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-quobyte-f11cd628-c032-467a-9716-ddaccdfb1b28" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] Acquiring lock "cinder-quobyte-16289ec2-121f-4c6a-b42e-25ada671a601" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-quobyte-16289ec2-121f-4c6a-b42e-25ada671a601" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] Deleting offline snapshot 16289ec2-121f-4c6a-b42e-25ada671a601 of volume f11cd628-c032-467a-9716-ddaccdfb1b28 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] snapshot_file for this snap is: volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[280f92bf-2fe8-45cd-95c6-8c32accb9747]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:47 devstack sudo[110245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601 Jun 15 07:34:47 devstack sudo[110245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:47 devstack sudo[110245]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601" returned: 0 in 0.749s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:47 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f11cd628-c032-467a-9716-ddaccdfb1b28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:34:47 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f692ea-82d9-4835-b846-37a5a15664ab]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:47 devstack sudo[110250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 Jun 15 07:34:47 devstack sudo[110250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:48 devstack sudo[110250]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28" returned: 0 in 0.718s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:48 devstack sudo[110256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601 Jun 15 07:34:48 devstack sudo[110256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:49 devstack sudo[110256]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601" returned: 0 in 0.709s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:49 devstack sudo[110262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601 Jun 15 07:34:49 devstack sudo[110262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:49 devstack sudo[110262]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28.16289ec2-121f-4c6a-b42e-25ada671a601" returned: 0 in 0.670s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-quobyte-16289ec2-121f-4c6a-b42e-25ada671a601" released by "_delete_snapshot" :: held 2.953s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-quobyte-f11cd628-c032-467a-9716-ddaccdfb1b28" released by "delete_snapshot" :: held 2.978s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:49 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] Created reservations ['0b518ddc-34ba-476c-a7c7-ad4a3af6d830', 'a07c8224-6534-4ce4-94c4-d710f8da0c4f', '74733362-3b00-4535-b460-8078de883759', 'c243f20c-e2eb-4555-848a-b23362934a50'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:34:49 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] Delete snapshot completed successfully. Jun 15 07:34:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3554b977-5fc7-4399-b8f5-1e1a2d986972 tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-16289ec2-121f-4c6a-b42e-25ada671a601-delete_snapshot" released by "delete_snapshot" :: held 3.124s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] Acquiring lock "cinder-f11cd628-c032-467a-9716-ddaccdfb1b28-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-f11cd628-c032-467a-9716-ddaccdfb1b28-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] Acquiring lock "cinder-quobyte-f11cd628-c032-467a-9716-ddaccdfb1b28" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:50 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-quobyte-f11cd628-c032-467a-9716-ddaccdfb1b28" acquired by "delete_volume" :: waited 0.020s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:50 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[66df2457-74b6-48ac-babb-b19c5a72e4d8]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:50 devstack sudo[110266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 Jun 15 07:34:50 devstack sudo[110266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:50 devstack sudo[110266]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28" returned: 0 in 0.786s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:50 devstack sudo[110272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28 Jun 15 07:34:50 devstack sudo[110272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:51 devstack sudo[110272]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f11cd628-c032-467a-9716-ddaccdfb1b28" returned: 0 in 0.607s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-quobyte-f11cd628-c032-467a-9716-ddaccdfb1b28" released by "delete_volume" :: held 1.475s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:51 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] Created reservations ['bd27e182-9ff0-4c35-9ec5-1bef7fe49b9e', '262890d1-3786-42b7-9d13-ce70287eba7e', '77abe5c1-59f3-4974-afcb-41b4a5d0aa9c', '1691c5c7-d017-45c2-be79-81459bd8bedc'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:34:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:51 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:51 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:51 devstack sudo[110275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:34:51 devstack sudo[110275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:52 devstack sudo[110275]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.601s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:52 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:34:52 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] Deleted volume successfully. Jun 15 07:34:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] Acquiring lock "cinder-4a2f9154-97b3-41bd-b93d-e44dddd56912-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2a968d7f-c8af-4e0a-a30c-84c3bdd8651f tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-f11cd628-c032-467a-9716-ddaccdfb1b28-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-4a2f9154-97b3-41bd-b93d-e44dddd56912-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] Acquiring lock "cinder-quobyte-4a2f9154-97b3-41bd-b93d-e44dddd56912" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-quobyte-4a2f9154-97b3-41bd-b93d-e44dddd56912" acquired by "delete_volume" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:52 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e918a8f-c60d-45d0-95df-db228beebe4b]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a2f9154-97b3-41bd-b93d-e44dddd56912 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:52 devstack sudo[110279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a2f9154-97b3-41bd-b93d-e44dddd56912 Jun 15 07:34:52 devstack sudo[110279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:53 devstack sudo[110279]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a2f9154-97b3-41bd-b93d-e44dddd56912" returned: 0 in 0.803s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a2f9154-97b3-41bd-b93d-e44dddd56912 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:53 devstack sudo[110284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a2f9154-97b3-41bd-b93d-e44dddd56912 Jun 15 07:34:53 devstack sudo[110284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:53 devstack sudo[110284]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4a2f9154-97b3-41bd-b93d-e44dddd56912" returned: 0 in 0.623s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:53 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-quobyte-4a2f9154-97b3-41bd-b93d-e44dddd56912" released by "delete_volume" :: held 1.475s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:53 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] Created reservations ['53a9053a-1888-41a7-be24-3635316b70d2', '86447a78-8119-4b05-a57d-bab3f4d72d6e', '786194e0-6885-486f-9630-63c797c21652', '1bd7f13e-4071-40be-8c6a-115000141008'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:34:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:54 devstack sudo[110288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:34:54 devstack sudo[110288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:54 devstack sudo[110288]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.622s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:54 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:34:54 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] Deleted volume successfully. Jun 15 07:34:54 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-5c34ee2c-6e42-4820-ae95-dd32f7aa5302 tempest-VolumeDependencyTests-1398716412 None] Lock "cinder-4a2f9154-97b3-41bd-b93d-e44dddd56912-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Flow 'volume_create_manager' (4a5a0f10-3953-4da9-8728-0287e91ac135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b02fe33-0ec1-4597-97c4-ae8f9a7a9aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b02fe33-0ec1-4597-97c4-ae8f9a7a9aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-396695529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1825e8ae-f2f7-45f5-b7be-1012ecc1d903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7271892c8df4dd885f037ce4e3564ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:57Z,use_quota=True,user_id='0964329b604549ccbe3762a2ffe5195e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bbb82d-9115-4357-9b9e-dd1618d7ccff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bbb82d-9115-4357-9b9e-dd1618d7ccff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af5cb03-86c4-4077-a901-dc1e828df574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af5cb03-86c4-4077-a901-dc1e828df574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1825e8ae-f2f7-45f5-b7be-1012ecc1d903', 'volume_name': 'volume-1825e8ae-f2f7-45f5-b7be-1012ecc1d903', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ba8f8f-cde2-4108-816b-8403a921c166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ba8f8f-cde2-4108-816b-8403a921c166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897ef907-84a7-472d-845f-897dd19f3ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:57 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume 1825e8ae-f2f7-45f5-b7be-1012ecc1d903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1825e8ae-f2f7-45f5-b7be-1012ecc1d903', 'volume_size': 1} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-396695529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1825e8ae-f2f7-45f5-b7be-1012ecc1d903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7271892c8df4dd885f037ce4e3564ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:57Z,use_quota=True,user_id='0964329b604549ccbe3762a2ffe5195e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Creating volume 1825e8ae-f2f7-45f5-b7be-1012ecc1d903 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:34:57 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1825e8ae-f2f7-45f5-b7be-1012ecc1d903 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:57 devstack sudo[110291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1825e8ae-f2f7-45f5-b7be-1012ecc1d903 1073741824 Jun 15 07:34:57 devstack sudo[110291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Flow 'volume_create_manager' (65c987ce-1b9e-489f-9217-78143ed36962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6f54e5-eca1-4e51-a5f1-8868a6799a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6f54e5-eca1-4e51-a5f1-8868a6799a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92d9977-90fe-4a51-adcd-7d3895d618a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77c9651d17c46dd85fc52b06259e76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:58Z,use_quota=True,user_id='6bbf2788e9e949d193518e63f366c489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763d594d-b6e4-4dbc-8cc5-183251082b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763d594d-b6e4-4dbc-8cc5-183251082b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c646ca2-fdf8-4169-b366-028bc4209783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c646ca2-fdf8-4169-b366-028bc4209783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a92d9977-90fe-4a51-adcd-7d3895d618a1', 'volume_name': 'volume-a92d9977-90fe-4a51-adcd-7d3895d618a1', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640c9b0d-d54e-4f2c-bf88-20d7a8a72f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640c9b0d-d54e-4f2c-bf88-20d7a8a72f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644b603c-971a-4fe3-81d1-b29feeee09ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:57 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Volume a92d9977-90fe-4a51-adcd-7d3895d618a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a92d9977-90fe-4a51-adcd-7d3895d618a1', 'volume_size': 1} Jun 15 07:34:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:58 devstack sudo[110291]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1825e8ae-f2f7-45f5-b7be-1012ecc1d903 1073741824" returned: 0 in 0.746s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1825e8ae-f2f7-45f5-b7be-1012ecc1d903 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:58 devstack sudo[110297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1825e8ae-f2f7-45f5-b7be-1012ecc1d903 Jun 15 07:34:58 devstack sudo[110297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:58 devstack sudo[110297]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1825e8ae-f2f7-45f5-b7be-1012ecc1d903" returned: 0 in 0.596s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.035s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92d9977-90fe-4a51-adcd-7d3895d618a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77c9651d17c46dd85fc52b06259e76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:58Z,use_quota=True,user_id='6bbf2788e9e949d193518e63f366c489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Creating volume a92d9977-90fe-4a51-adcd-7d3895d618a1 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:34:58 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a92d9977-90fe-4a51-adcd-7d3895d618a1 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:58 devstack sudo[110300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a92d9977-90fe-4a51-adcd-7d3895d618a1 1073741824 Jun 15 07:34:58 devstack sudo[110300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897ef907-84a7-472d-845f-897dd19f3ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1825e8ae-f2f7-45f5-b7be-1012ecc1d903', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91efc02-ad1b-456a-b7bc-89dd402fcbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:58 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume volume-1825e8ae-f2f7-45f5-b7be-1012ecc1d903 (1825e8ae-f2f7-45f5-b7be-1012ecc1d903): created successfully Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91efc02-ad1b-456a-b7bc-89dd402fcbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Flow 'volume_create_manager' (4a5a0f10-3953-4da9-8728-0287e91ac135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:58 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-85cb7d67-75c8-4ef0-b745-e29404eb76e1 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Created volume successfully. Jun 15 07:34:59 devstack sudo[110300]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a92d9977-90fe-4a51-adcd-7d3895d618a1 1073741824" returned: 0 in 0.782s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a92d9977-90fe-4a51-adcd-7d3895d618a1 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:59 devstack sudo[110307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a92d9977-90fe-4a51-adcd-7d3895d618a1 Jun 15 07:34:59 devstack sudo[110307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:59 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Flow 'volume_create_manager' (1039269d-ff8e-4ef5-96ba-cb5a7a8a61a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a891707-6e6c-4b36-8f57-561ecb590498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a891707-6e6c-4b36-8f57-561ecb590498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-20618669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e792fc7-ccf3-4f55-bd5b-a52d23ccac01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7271892c8df4dd885f037ce4e3564ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:00Z,use_quota=True,user_id='0964329b604549ccbe3762a2ffe5195e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c082c09-930c-4237-aea2-ca8a2019de69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c082c09-930c-4237-aea2-ca8a2019de69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a534248-d3cf-4c7d-b785-70da3d2068e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a534248-d3cf-4c7d-b785-70da3d2068e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e792fc7-ccf3-4f55-bd5b-a52d23ccac01', 'volume_name': 'volume-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1ca422-cc2f-4ced-8856-12d9c094fde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1ca422-cc2f-4ced-8856-12d9c094fde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74bcce7-0d5a-404f-b23d-c01ff217ed9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:00 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume 0e792fc7-ccf3-4f55-bd5b-a52d23ccac01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01', 'volume_size': 1} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:00 devstack sudo[110307]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Flow 'volume_create_manager' (1416c5ab-e67a-4e63-8457-51749ac2804f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1ab342-13f6-4cc4-aaf2-fa94fc65af12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a92d9977-90fe-4a51-adcd-7d3895d618a1" returned: 0 in 0.727s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.332s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-20618669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e792fc7-ccf3-4f55-bd5b-a52d23ccac01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7271892c8df4dd885f037ce4e3564ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:00Z,use_quota=True,user_id='0964329b604549ccbe3762a2ffe5195e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Creating volume 0e792fc7-ccf3-4f55-bd5b-a52d23ccac01 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:35:00 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1ab342-13f6-4cc4-aaf2-fa94fc65af12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-465171217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5734da67-cec6-4c44-85fc-8176988e995e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7271892c8df4dd885f037ce4e3564ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:00Z,use_quota=True,user_id='0964329b604549ccbe3762a2ffe5195e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:00 devstack sudo[110312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01 1073741824 Jun 15 07:35:00 devstack sudo[110312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d19e5cf3-8615-4f02-91d7-071666c4aa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d19e5cf3-8615-4f02-91d7-071666c4aa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e41b89-384b-4795-a866-0b798527f183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e41b89-384b-4795-a866-0b798527f183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5734da67-cec6-4c44-85fc-8176988e995e', 'volume_name': 'volume-5734da67-cec6-4c44-85fc-8176988e995e', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76d5110-c530-4cce-8cce-c5d0e43f6eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76d5110-c530-4cce-8cce-c5d0e43f6eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2874aabd-d431-4110-8c44-fc9fa8ae0b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:00 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume 5734da67-cec6-4c44-85fc-8176988e995e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5734da67-cec6-4c44-85fc-8176988e995e', 'volume_size': 1} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644b603c-971a-4fe3-81d1-b29feeee09ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92d9977-90fe-4a51-adcd-7d3895d618a1', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396b4c7b-3660-4220-b7d1-61a302b2c3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:00 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Volume volume-a92d9977-90fe-4a51-adcd-7d3895d618a1 (a92d9977-90fe-4a51-adcd-7d3895d618a1): created successfully Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396b4c7b-3660-4220-b7d1-61a302b2c3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Flow 'volume_create_manager' (65c987ce-1b9e-489f-9217-78143ed36962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:00 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c46ba53b-ec29-410f-831a-9038d4dc9792 tempest-CinderUnicodeTest-1082529067 None] Created volume successfully. Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Flow 'volume_create_manager' (38cb8141-97b5-4084-9c30-a8b48cae2aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a51a80-3f23-4a1d-b8a6-a361684d0fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a51a80-3f23-4a1d-b8a6-a361684d0fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2052205061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4064fdc-078f-41bf-98bd-f3c32d830b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7271892c8df4dd885f037ce4e3564ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:01Z,use_quota=True,user_id='0964329b604549ccbe3762a2ffe5195e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16854fc3-2af9-4e99-a509-0221a814d69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16854fc3-2af9-4e99-a509-0221a814d69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb942efd-4b14-469c-b84d-7660a65f4fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb942efd-4b14-469c-b84d-7660a65f4fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4064fdc-078f-41bf-98bd-f3c32d830b8f', 'volume_name': 'volume-a4064fdc-078f-41bf-98bd-f3c32d830b8f', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde2942c-f5ac-4f66-8e20-f7b4a57937ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde2942c-f5ac-4f66-8e20-f7b4a57937ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d75395a-97ee-4f7f-a0da-890823574c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:00 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume a4064fdc-078f-41bf-98bd-f3c32d830b8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4064fdc-078f-41bf-98bd-f3c32d830b8f', 'volume_size': 1} Jun 15 07:35:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Flow 'volume_create_manager' (d5362763-2e03-4dca-81d1-bb1e8174b3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728a8731-0c91-49a2-b8ef-b7c29bdc14cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728a8731-0c91-49a2-b8ef-b7c29bdc14cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1705969773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0298cdb3-c761-43d7-9106-0f14a5702d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7271892c8df4dd885f037ce4e3564ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:01Z,use_quota=True,user_id='0964329b604549ccbe3762a2ffe5195e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab2465f-94a3-452e-a1a2-d5bbc51bb262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab2465f-94a3-452e-a1a2-d5bbc51bb262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0b4c73-9e66-49ff-8c90-930d6800fe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0b4c73-9e66-49ff-8c90-930d6800fe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0298cdb3-c761-43d7-9106-0f14a5702d66', 'volume_name': 'volume-0298cdb3-c761-43d7-9106-0f14a5702d66', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c89fab2-32dd-42a0-b5c6-6fb4284320c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c89fab2-32dd-42a0-b5c6-6fb4284320c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb04503b-2b43-40a0-a7e6-20a5d6f089a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:01 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume 0298cdb3-c761-43d7-9106-0f14a5702d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0298cdb3-c761-43d7-9106-0f14a5702d66', 'volume_size': 1} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:01 devstack sudo[110312]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01 1073741824" returned: 0 in 0.932s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Flow 'volume_create_manager' (a18d7236-7790-4f6f-9dfe-5a2f874a5731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddf07bd-1dfe-4f0d-ab76-0658ea6e9ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:01 devstack sudo[110322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01 Jun 15 07:35:01 devstack sudo[110322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddf07bd-1dfe-4f0d-ab76-0658ea6e9ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-635805558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b1a844-4517-48cf-9cff-d0b7fd14bf04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7271892c8df4dd885f037ce4e3564ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:01Z,use_quota=True,user_id='0964329b604549ccbe3762a2ffe5195e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce635828-a018-4d8e-a8e1-aa15bf306ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce635828-a018-4d8e-a8e1-aa15bf306ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d20e2c84-8869-4691-bdce-e674c75ecd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d20e2c84-8869-4691-bdce-e674c75ecd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04b1a844-4517-48cf-9cff-d0b7fd14bf04', 'volume_name': 'volume-04b1a844-4517-48cf-9cff-d0b7fd14bf04', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcccd11-6007-43e0-b1f4-4d8e4f47e806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcccd11-6007-43e0-b1f4-4d8e4f47e806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f9565a-c750-4c7c-969d-ec1feeb2ba20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:01 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume 04b1a844-4517-48cf-9cff-d0b7fd14bf04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04b1a844-4517-48cf-9cff-d0b7fd14bf04', 'volume_size': 1} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Flow 'volume_create_manager' (5d6d0b55-d634-4e3d-b43e-bb32b016717f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (552a2b7f-21fa-4598-b835-21caa7f7c816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (552a2b7f-21fa-4598-b835-21caa7f7c816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1863913212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6bb679-1d89-4ebd-aba0-e3e7d038b92f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77c9651d17c46dd85fc52b06259e76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:02Z,use_quota=True,user_id='6bbf2788e9e949d193518e63f366c489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8909af7-8188-44f0-b1e2-099616516364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8909af7-8188-44f0-b1e2-099616516364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccdead7b-a7b2-48eb-8c36-f95424279b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccdead7b-a7b2-48eb-8c36-f95424279b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed6bb679-1d89-4ebd-aba0-e3e7d038b92f', 'volume_name': 'volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1c0613-cb10-4e65-abd6-e8a4da3cf38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1c0613-cb10-4e65-abd6-e8a4da3cf38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acc1d51-a317-4e4c-860c-a32d1c3c8be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:01 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Volume ed6bb679-1d89-4ebd-aba0-e3e7d038b92f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f', 'volume_size': 1} Jun 15 07:35:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:02 devstack sudo[110322]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01" returned: 0 in 0.621s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.587s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-465171217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5734da67-cec6-4c44-85fc-8176988e995e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7271892c8df4dd885f037ce4e3564ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:00Z,use_quota=True,user_id='0964329b604549ccbe3762a2ffe5195e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Creating volume 5734da67-cec6-4c44-85fc-8176988e995e {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:35:02 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5734da67-cec6-4c44-85fc-8176988e995e 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74bcce7-0d5a-404f-b23d-c01ff217ed9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:02 devstack sudo[110325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5734da67-cec6-4c44-85fc-8176988e995e 1073741824 Jun 15 07:35:02 devstack sudo[110325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c427f63d-5ba5-4637-a192-a8d99a8749ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:02 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume volume-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01 (0e792fc7-ccf3-4f55-bd5b-a52d23ccac01): created successfully Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c427f63d-5ba5-4637-a192-a8d99a8749ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Flow 'volume_create_manager' (1039269d-ff8e-4ef5-96ba-cb5a7a8a61a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:02 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-56db46b6-faac-4e64-9018-ebe104d5e1dc tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Created volume successfully. Jun 15 07:35:02 devstack sudo[110325]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5734da67-cec6-4c44-85fc-8176988e995e 1073741824" returned: 0 in 0.775s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5734da67-cec6-4c44-85fc-8176988e995e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:02 devstack sudo[110331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5734da67-cec6-4c44-85fc-8176988e995e Jun 15 07:35:02 devstack sudo[110331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:03 devstack sudo[110331]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5734da67-cec6-4c44-85fc-8176988e995e" returned: 0 in 0.574s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.665s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2052205061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4064fdc-078f-41bf-98bd-f3c32d830b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7271892c8df4dd885f037ce4e3564ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:01Z,use_quota=True,user_id='0964329b604549ccbe3762a2ffe5195e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Creating volume a4064fdc-078f-41bf-98bd-f3c32d830b8f {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:35:03 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a4064fdc-078f-41bf-98bd-f3c32d830b8f 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2874aabd-d431-4110-8c44-fc9fa8ae0b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5734da67-cec6-4c44-85fc-8176988e995e', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fcfa0a-f437-41e2-94df-956814f201de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:03 devstack sudo[110334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a4064fdc-078f-41bf-98bd-f3c32d830b8f 1073741824 Jun 15 07:35:03 devstack sudo[110334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:03 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume volume-5734da67-cec6-4c44-85fc-8176988e995e (5734da67-cec6-4c44-85fc-8176988e995e): created successfully Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fcfa0a-f437-41e2-94df-956814f201de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Flow 'volume_create_manager' (1416c5ab-e67a-4e63-8457-51749ac2804f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:03 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:UPDATE=110,cinder:SELECT=77,cinder:DELETE=8,cinder:INSERT=18 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:35:03 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-fee5cc6e-691c-4577-b3db-17d81002821d tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Created volume successfully. Jun 15 07:35:04 devstack sudo[110334]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a4064fdc-078f-41bf-98bd-f3c32d830b8f 1073741824" returned: 0 in 0.826s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=76,cinder:UPDATE=100,cinder:INSERT=30,cinder:DELETE=12 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a4064fdc-078f-41bf-98bd-f3c32d830b8f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:04 devstack sudo[110339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a4064fdc-078f-41bf-98bd-f3c32d830b8f Jun 15 07:35:04 devstack sudo[110339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:04 devstack sudo[110339]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a4064fdc-078f-41bf-98bd-f3c32d830b8f" returned: 0 in 0.580s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.741s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1705969773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0298cdb3-c761-43d7-9106-0f14a5702d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7271892c8df4dd885f037ce4e3564ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:01Z,use_quota=True,user_id='0964329b604549ccbe3762a2ffe5195e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Creating volume 0298cdb3-c761-43d7-9106-0f14a5702d66 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:35:04 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0298cdb3-c761-43d7-9106-0f14a5702d66 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:04 devstack sudo[110342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0298cdb3-c761-43d7-9106-0f14a5702d66 1073741824 Jun 15 07:35:04 devstack sudo[110342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d75395a-97ee-4f7f-a0da-890823574c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4064fdc-078f-41bf-98bd-f3c32d830b8f', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1109584-7d23-4c1c-b288-657369a2a35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:04 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume volume-a4064fdc-078f-41bf-98bd-f3c32d830b8f (a4064fdc-078f-41bf-98bd-f3c32d830b8f): created successfully Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1109584-7d23-4c1c-b288-657369a2a35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:04 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Flow 'volume_create_manager' (38cb8141-97b5-4084-9c30-a8b48cae2aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:04 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f9efe239-0b75-4903-9dda-8866981b259b tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Created volume successfully. Jun 15 07:35:05 devstack sudo[110342]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0298cdb3-c761-43d7-9106-0f14a5702d66 1073741824" returned: 0 in 0.755s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0298cdb3-c761-43d7-9106-0f14a5702d66 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:05 devstack sudo[110347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0298cdb3-c761-43d7-9106-0f14a5702d66 Jun 15 07:35:05 devstack sudo[110347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:06 devstack sudo[110347]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0298cdb3-c761-43d7-9106-0f14a5702d66" returned: 0 in 0.616s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:35:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.789s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-635805558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b1a844-4517-48cf-9cff-d0b7fd14bf04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7271892c8df4dd885f037ce4e3564ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:01Z,use_quota=True,user_id='0964329b604549ccbe3762a2ffe5195e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:35:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Creating volume 04b1a844-4517-48cf-9cff-d0b7fd14bf04 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:35:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:35:06 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:35:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-04b1a844-4517-48cf-9cff-d0b7fd14bf04 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb04503b-2b43-40a0-a7e6-20a5d6f089a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0298cdb3-c761-43d7-9106-0f14a5702d66', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:06 devstack sudo[110350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-04b1a844-4517-48cf-9cff-d0b7fd14bf04 1073741824 Jun 15 07:35:06 devstack sudo[110350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630eb80f-4046-41d6-a218-cbc3df2a1c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:06 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume volume-0298cdb3-c761-43d7-9106-0f14a5702d66 (0298cdb3-c761-43d7-9106-0f14a5702d66): created successfully Jun 15 07:35:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630eb80f-4046-41d6-a218-cbc3df2a1c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:06 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Flow 'volume_create_manager' (d5362763-2e03-4dca-81d1-bb1e8174b3a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:06 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-272d1007-7439-4232-9633-1751acbcd067 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Created volume successfully. Jun 15 07:35:07 devstack sudo[110350]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-04b1a844-4517-48cf-9cff-d0b7fd14bf04 1073741824" returned: 0 in 0.746s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-04b1a844-4517-48cf-9cff-d0b7fd14bf04 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:07 devstack sudo[110355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-04b1a844-4517-48cf-9cff-d0b7fd14bf04 Jun 15 07:35:07 devstack sudo[110355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:07 devstack sudo[110355]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-04b1a844-4517-48cf-9cff-d0b7fd14bf04" returned: 0 in 0.596s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.072s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1863913212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6bb679-1d89-4ebd-aba0-e3e7d038b92f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77c9651d17c46dd85fc52b06259e76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:02Z,use_quota=True,user_id='6bbf2788e9e949d193518e63f366c489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Creating volume ed6bb679-1d89-4ebd-aba0-e3e7d038b92f {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:35:07 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:07 devstack sudo[110358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f 1073741824 Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f9565a-c750-4c7c-969d-ec1feeb2ba20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04b1a844-4517-48cf-9cff-d0b7fd14bf04', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:07 devstack sudo[110358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2742fe8-2dfa-42e9-99ee-7e6f657a8899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:07 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Volume volume-04b1a844-4517-48cf-9cff-d0b7fd14bf04 (04b1a844-4517-48cf-9cff-d0b7fd14bf04): created successfully Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2742fe8-2dfa-42e9-99ee-7e6f657a8899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Flow 'volume_create_manager' (a18d7236-7790-4f6f-9dfe-5a2f874a5731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:07 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-ee678d18-f707-4f8f-8c8e-1d58004787f4 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Created volume successfully. Jun 15 07:35:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "cinder-04b1a844-4517-48cf-9cff-d0b7fd14bf04-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-04b1a844-4517-48cf-9cff-d0b7fd14bf04-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "cinder-quobyte-04b1a844-4517-48cf-9cff-d0b7fd14bf04" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-quobyte-04b1a844-4517-48cf-9cff-d0b7fd14bf04" acquired by "delete_volume" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:08 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d804c4b4-efb9-4c29-8446-3bf2a0e03d25]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-04b1a844-4517-48cf-9cff-d0b7fd14bf04 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:08 devstack sudo[110360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-04b1a844-4517-48cf-9cff-d0b7fd14bf04 Jun 15 07:35:08 devstack sudo[110360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:08 devstack sudo[110358]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f 1073741824" returned: 0 in 0.779s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:08 devstack sudo[110365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f Jun 15 07:35:08 devstack sudo[110365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:08 devstack sudo[110360]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-04b1a844-4517-48cf-9cff-d0b7fd14bf04" returned: 0 in 0.715s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-04b1a844-4517-48cf-9cff-d0b7fd14bf04 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:08 devstack sudo[110370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-04b1a844-4517-48cf-9cff-d0b7fd14bf04 Jun 15 07:35:08 devstack sudo[110370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:09 devstack sudo[110365]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f" returned: 0 in 0.582s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:35:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acc1d51-a317-4e4c-860c-a32d1c3c8be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5236801-05d1-4f99-8eb1-4ebe48be1310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:09 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Volume volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f (ed6bb679-1d89-4ebd-aba0-e3e7d038b92f): created successfully Jun 15 07:35:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5236801-05d1-4f99-8eb1-4ebe48be1310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Flow 'volume_create_manager' (5d6d0b55-d634-4e3d-b43e-bb32b016717f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:09 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-15ae60c4-9fae-405b-9f79-92444e3d176c tempest-CinderUnicodeTest-1082529067 None] Created volume successfully. Jun 15 07:35:09 devstack sudo[110370]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-04b1a844-4517-48cf-9cff-d0b7fd14bf04" returned: 0 in 0.616s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-quobyte-04b1a844-4517-48cf-9cff-d0b7fd14bf04" released by "delete_volume" :: held 1.367s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:09 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Created reservations ['2afaa136-312d-4e30-be3d-cec82dc36ad2', 'd12d755b-d8b8-4b4a-8bfa-df3614fdc0b2', '72e552f0-a591-4dbb-9ab3-effc63c9d4bd', 'aa4b01aa-d545-413e-81d7-32a0426eb59b'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:35:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:09 devstack sudo[110374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:35:09 devstack sudo[110374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:10 devstack sudo[110374]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.593s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:10 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:10 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Deleted volume successfully. Jun 15 07:35:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c3e6a2ca-bc07-428b-9e0d-80fe1f8941cd tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-04b1a844-4517-48cf-9cff-d0b7fd14bf04-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "cinder-0298cdb3-c761-43d7-9106-0f14a5702d66-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-0298cdb3-c761-43d7-9106-0f14a5702d66-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:10 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] Creating offline snapshot ba460de5-d2ef-4a78-91e5-a13a49a6b91b of volume ed6bb679-1d89-4ebd-aba0-e3e7d038b92f {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:35:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "cinder-quobyte-0298cdb3-c761-43d7-9106-0f14a5702d66" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:10 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[638cce92-338e-4952-8855-7caf43400e4d]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-quobyte-0298cdb3-c761-43d7-9106-0f14a5702d66" acquired by "delete_volume" :: waited 0.031s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:10 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[225755b9-8c29-4e61-8c76-c1c77ef37842]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0298cdb3-c761-43d7-9106-0f14a5702d66 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:10 devstack sudo[110379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f Jun 15 07:35:10 devstack sudo[110379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:10 devstack sudo[110380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0298cdb3-c761-43d7-9106-0f14a5702d66 Jun 15 07:35:10 devstack sudo[110380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:11 devstack sudo[110379]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f" returned: 0 in 0.714s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:11 devstack sudo[110380]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0298cdb3-c761-43d7-9106-0f14a5702d66" returned: 0 in 0.678s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0298cdb3-c761-43d7-9106-0f14a5702d66 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:11 devstack sudo[110389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b 1G Jun 15 07:35:11 devstack sudo[110389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:11 devstack sudo[110390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0298cdb3-c761-43d7-9106-0f14a5702d66 Jun 15 07:35:11 devstack sudo[110390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:11 devstack sudo[110390]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0298cdb3-c761-43d7-9106-0f14a5702d66" returned: 0 in 0.599s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:11 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-quobyte-0298cdb3-c761-43d7-9106-0f14a5702d66" released by "delete_volume" :: held 1.316s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:11 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Created reservations ['63c74e7f-f432-47f8-af46-06a3ad439c18', '32598b53-0529-4e9e-9baa-4d54c9352b7d', '7201d796-2de0-46ff-b103-292d4311315a', '9a42f5bf-948f-4135-bac5-f72e6a7e3c14'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:35:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:11 devstack sudo[110398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:35:11 devstack sudo[110398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:11 devstack sudo[110389]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b 1G" returned: 0 in 0.790s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:11 devstack sudo[110400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b Jun 15 07:35:11 devstack sudo[110400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:12 devstack sudo[110398]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.573s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:12 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:12 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Deleted volume successfully. Jun 15 07:35:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-979c19d8-9aac-40cf-ac0a-bf27af82501a tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-0298cdb3-c761-43d7-9106-0f14a5702d66-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "cinder-a4064fdc-078f-41bf-98bd-f3c32d830b8f-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:12 devstack sudo[110400]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b" returned: 0 in 0.670s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:12 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b is being set with open permissions: ugo+rw Jun 15 07:35:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-a4064fdc-078f-41bf-98bd-f3c32d830b8f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:12 devstack sudo[110408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b Jun 15 07:35:12 devstack sudo[110408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "cinder-quobyte-a4064fdc-078f-41bf-98bd-f3c32d830b8f" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-quobyte-a4064fdc-078f-41bf-98bd-f3c32d830b8f" acquired by "delete_volume" :: waited 0.014s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:12 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9318ba-066f-4b1a-a76a-c624f796df89]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a4064fdc-078f-41bf-98bd-f3c32d830b8f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:12 devstack sudo[110410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a4064fdc-078f-41bf-98bd-f3c32d830b8f Jun 15 07:35:12 devstack sudo[110410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:13 devstack sudo[110408]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b" returned: 0 in 0.579s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:13 devstack sudo[110413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.info Jun 15 07:35:13 devstack sudo[110413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:13 devstack sudo[110410]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a4064fdc-078f-41bf-98bd-f3c32d830b8f" returned: 0 in 0.703s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a4064fdc-078f-41bf-98bd-f3c32d830b8f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:13 devstack sudo[110418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a4064fdc-078f-41bf-98bd-f3c32d830b8f Jun 15 07:35:13 devstack sudo[110418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:13 devstack sudo[110413]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.info" returned: 0 in 0.577s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:13 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.info is being set with open permissions: ugo+rw Jun 15 07:35:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:13 devstack sudo[110421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.info Jun 15 07:35:13 devstack sudo[110421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:13 devstack sudo[110418]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a4064fdc-078f-41bf-98bd-f3c32d830b8f" returned: 0 in 0.585s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-quobyte-a4064fdc-078f-41bf-98bd-f3c32d830b8f" released by "delete_volume" :: held 1.331s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:35:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:13 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Created reservations ['43e3f882-9bb0-4b3f-88c8-c1d19d68c90b', 'c9ea259e-3366-47f1-ada4-65bac8fdeb54', '1c7ca1c6-26eb-44ef-8426-fd64c3191f88', 'e30453c0-efff-428f-be05-f3e0854681ab'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:35:13 devstack sudo[110424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:35:13 devstack sudo[110424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:14 devstack sudo[110426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:35:14 devstack sudo[110426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:14 devstack sudo[110421]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.info" returned: 0 in 0.590s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.017s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:14 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-194532bd-0137-456d-8388-ef503d4fd3a9 tempest-CinderUnicodeTest-1082529067 None] Create snapshot completed successfully Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] Acquiring lock "cinder-ba460de5-d2ef-4a78-91e5-a13a49a6b91b-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] Lock "cinder-ba460de5-d2ef-4a78-91e5-a13a49a6b91b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] Acquiring lock "cinder-quobyte-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] Lock "cinder-quobyte-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] Acquiring lock "cinder-quobyte-ba460de5-d2ef-4a78-91e5-a13a49a6b91b" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] Lock "cinder-quobyte-ba460de5-d2ef-4a78-91e5-a13a49a6b91b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] Deleting offline snapshot ba460de5-d2ef-4a78-91e5-a13a49a6b91b of volume ed6bb679-1d89-4ebd-aba0-e3e7d038b92f {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] snapshot_file for this snap is: volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[56008871-0785-4ce7-a0f0-c54f4b9f3a4d]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:14 devstack sudo[110424]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.649s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 28 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:35:14 devstack sudo[110430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b Jun 15 07:35:14 devstack sudo[110430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:14 devstack sudo[110426]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.666s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "cinder-5734da67-cec6-4c44-85fc-8176988e995e-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:14 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Deleted volume successfully. Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-5734da67-cec6-4c44-85fc-8176988e995e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-b9bff6e4-9d1d-4a3b-833e-b9e45726c625 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-a4064fdc-078f-41bf-98bd-f3c32d830b8f-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "cinder-quobyte-5734da67-cec6-4c44-85fc-8176988e995e" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-quobyte-5734da67-cec6-4c44-85fc-8176988e995e" acquired by "delete_volume" :: waited 0.013s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8715ad95-ee42-49b6-8882-f2da8eb35b37]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5734da67-cec6-4c44-85fc-8176988e995e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:14 devstack sudo[110433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5734da67-cec6-4c44-85fc-8176988e995e Jun 15 07:35:14 devstack sudo[110433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:15 devstack sudo[110430]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b" returned: 0 in 0.771s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:15 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:35:15 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a933296-2188-4abc-8dd2-769c684971b3]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:15 devstack sudo[110438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f Jun 15 07:35:15 devstack sudo[110438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:15 devstack sudo[110433]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5734da67-cec6-4c44-85fc-8176988e995e" returned: 0 in 0.702s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5734da67-cec6-4c44-85fc-8176988e995e {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:15 devstack sudo[110443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5734da67-cec6-4c44-85fc-8176988e995e Jun 15 07:35:15 devstack sudo[110443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:16 devstack sudo[110438]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f" returned: 0 in 0.690s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:16 devstack sudo[110449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b Jun 15 07:35:16 devstack sudo[110449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:16 devstack sudo[110443]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5734da67-cec6-4c44-85fc-8176988e995e" returned: 0 in 0.585s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-quobyte-5734da67-cec6-4c44-85fc-8176988e995e" released by "delete_volume" :: held 1.335s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:16 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Created reservations ['901be42c-ecd9-445b-b920-9bf352385921', '7a66a0b0-68eb-450d-a5e6-97493e37fbb3', '9e7417bb-d8ff-43f7-987a-c22fa9c44064', 'a948af67-f7cd-455d-8337-aa18151625dc'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:35:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:16 devstack sudo[110451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:35:16 devstack sudo[110451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:16 devstack sudo[110449]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b" returned: 0 in 0.670s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:16 devstack sudo[110456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b Jun 15 07:35:16 devstack sudo[110456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:16 devstack sudo[110451]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.642s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:16 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:16 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Deleted volume successfully. Jun 15 07:35:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-0e135e1c-b550-4048-b63a-7b8f3b50f399 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-5734da67-cec6-4c44-85fc-8176988e995e-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "cinder-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "cinder-quobyte-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-quobyte-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01" acquired by "delete_volume" :: waited 0.014s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4957599-55de-499f-8938-fe24072b012f]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:17 devstack sudo[110459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01 Jun 15 07:35:17 devstack sudo[110459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:17 devstack sudo[110456]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f.ba460de5-d2ef-4a78-91e5-a13a49a6b91b" returned: 0 in 0.616s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] Lock "cinder-quobyte-ba460de5-d2ef-4a78-91e5-a13a49a6b91b" released by "_delete_snapshot" :: held 2.876s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] Lock "cinder-quobyte-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f" released by "delete_snapshot" :: held 2.909s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] Created reservations ['26b927ea-234d-49bf-8ac3-c0716794a289', '994b858f-8829-45ed-b4ea-cc0370cb2f76', 'cc2749df-99ac-475b-9d09-71c4a2fe8631', '0f9a0b8c-5c05-4163-b166-bea8cbe63276'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:35:17 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] Delete snapshot completed successfully. Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1cc8e77f-a76f-450a-a05b-8c2c1069e47c tempest-CinderUnicodeTest-1082529067 None] Lock "cinder-ba460de5-d2ef-4a78-91e5-a13a49a6b91b-delete_snapshot" released by "delete_snapshot" :: held 3.049s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] Acquiring lock "cinder-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] Lock "cinder-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] Acquiring lock "cinder-quobyte-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] Lock "cinder-quobyte-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f" acquired by "delete_volume" :: waited 0.016s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[24328e8b-52ed-4458-b526-304c1885594f]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:17 devstack sudo[110459]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01" returned: 0 in 0.739s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:17 devstack sudo[110467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01 Jun 15 07:35:17 devstack sudo[110467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:17 devstack sudo[110466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f Jun 15 07:35:17 devstack sudo[110466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:18 devstack sudo[110467]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01" returned: 0 in 0.601s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:18 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-quobyte-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01" released by "delete_volume" :: held 1.381s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:18 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Created reservations ['2d4dee52-593b-4595-acf1-ea424ec82538', 'a07b9a7f-f9ca-4ae3-aac6-3896a6f1f053', '37f1e11c-d491-4dde-b151-2ea93de535c7', '6354abdb-73bd-4e41-b3c1-be07d268b074'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:35:18 devstack sudo[110466]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f" returned: 0 in 0.695s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:18 devstack sudo[110474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f Jun 15 07:35:18 devstack sudo[110474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:18 devstack sudo[110476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:35:18 devstack sudo[110476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:19 devstack sudo[110474]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f" returned: 0 in 0.573s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] Lock "cinder-quobyte-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f" released by "delete_volume" :: held 1.335s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:19 devstack sudo[110476]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.577s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:19 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Deleted volume successfully. Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] Created reservations ['aa2a7d19-4503-4326-b8d0-31efcb5ea7f5', '470e03b6-f88b-444c-88ab-4e97f72555c2', '64ec5a5d-73e0-4908-9741-dfcb42f39316', 'a2fd372d-2910-4b3b-8e61-89a8e82b8d7f'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-ab433c85-e133-4bc5-9b1b-a900e9616a59 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-0e792fc7-ccf3-4f55-bd5b-a52d23ccac01-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "cinder-1825e8ae-f2f7-45f5-b7be-1012ecc1d903-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-1825e8ae-f2f7-45f5-b7be-1012ecc1d903-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:19 devstack sudo[110480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:35:19 devstack sudo[110480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "cinder-quobyte-1825e8ae-f2f7-45f5-b7be-1012ecc1d903" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-quobyte-1825e8ae-f2f7-45f5-b7be-1012ecc1d903" acquired by "delete_volume" :: waited 0.021s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[020ae1e8-b91c-401b-bd56-a0f8447edea2]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1825e8ae-f2f7-45f5-b7be-1012ecc1d903 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:19 devstack sudo[110482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1825e8ae-f2f7-45f5-b7be-1012ecc1d903 Jun 15 07:35:19 devstack sudo[110482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:19 devstack sudo[110480]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.581s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:19 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] Deleted volume successfully. Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e961a6de-4b68-4fa3-a598-f23d6ab42c17 tempest-CinderUnicodeTest-1082529067 None] Lock "cinder-ed6bb679-1d89-4ebd-aba0-e3e7d038b92f-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] Acquiring lock "cinder-a92d9977-90fe-4a51-adcd-7d3895d618a1-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] Lock "cinder-a92d9977-90fe-4a51-adcd-7d3895d618a1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] Acquiring lock "cinder-quobyte-a92d9977-90fe-4a51-adcd-7d3895d618a1" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] Lock "cinder-quobyte-a92d9977-90fe-4a51-adcd-7d3895d618a1" acquired by "delete_volume" :: waited 0.018s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:20 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e3c2d0-a8d4-4d73-b43c-2947e4fc8c75]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a92d9977-90fe-4a51-adcd-7d3895d618a1 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:20 devstack sudo[110482]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1825e8ae-f2f7-45f5-b7be-1012ecc1d903" returned: 0 in 0.740s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1825e8ae-f2f7-45f5-b7be-1012ecc1d903 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:20 devstack sudo[110490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1825e8ae-f2f7-45f5-b7be-1012ecc1d903 Jun 15 07:35:20 devstack sudo[110490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:20 devstack sudo[110489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a92d9977-90fe-4a51-adcd-7d3895d618a1 Jun 15 07:35:20 devstack sudo[110489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:20 devstack sudo[110490]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1825e8ae-f2f7-45f5-b7be-1012ecc1d903" returned: 0 in 0.582s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-quobyte-1825e8ae-f2f7-45f5-b7be-1012ecc1d903" released by "delete_volume" :: held 1.368s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:20 devstack sudo[110489]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a92d9977-90fe-4a51-adcd-7d3895d618a1" returned: 0 in 0.694s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a92d9977-90fe-4a51-adcd-7d3895d618a1 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:20 devstack sudo[110497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a92d9977-90fe-4a51-adcd-7d3895d618a1 Jun 15 07:35:20 devstack sudo[110497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:20 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Created reservations ['5fdb4d7e-c1e2-40e7-b4b7-42d713e6f7cf', '402365f3-0f26-4d44-b77c-1624cca854a6', '5629249b-8719-4f23-8a30-551e293525db', '4d271826-a042-4e00-add4-486ba3c8bd74'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:35:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:20 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:20 devstack sudo[110499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:35:20 devstack sudo[110499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:21 devstack sudo[110497]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a92d9977-90fe-4a51-adcd-7d3895d618a1" returned: 0 in 0.583s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] Lock "cinder-quobyte-a92d9977-90fe-4a51-adcd-7d3895d618a1" released by "delete_volume" :: held 1.314s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:21 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] Created reservations ['10803d5d-bc9e-4633-967c-05703a2a13cc', '6933eded-8443-4939-8d2c-75865251aef6', 'b23a9ebf-cd4e-42a3-b67b-bc4043ed2852', 'a4025c92-8479-486f-a2ee-fcd979d95406'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:35:21 devstack sudo[110499]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.586s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:21 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:21 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Deleted volume successfully. Jun 15 07:35:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-34eae961-b6fa-476c-a427-b48470d4f979 tempest-CreateVolumesFromSourceVolumeTest-1533501994 None] Lock "cinder-1825e8ae-f2f7-45f5-b7be-1012ecc1d903-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:21 devstack sudo[110503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:35:21 devstack sudo[110503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:22 devstack sudo[110503]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.603s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:22 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:22 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] Deleted volume successfully. Jun 15 07:35:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c757c277-f582-42af-9a68-75584941ca20 tempest-CinderUnicodeTest-1082529067 None] Lock "cinder-a92d9977-90fe-4a51-adcd-7d3895d618a1-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:26 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Flow 'volume_create_manager' (8d6e4dae-bd11-473a-bad2-bfe18ab76bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6536a40e-69f4-4a6c-9407-89e6bbb6e880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6536a40e-69f4-4a6c-9407-89e6bbb6e880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee414d4-0161-4059-9432-67b6a9fbf8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ad3774e1c674a56a4243eae3bb12cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:26Z,use_quota=True,user_id='0321d12cefc042bb9d1529c51491c918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4289fd31-8c33-4646-ae1b-d62ff91bf395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4289fd31-8c33-4646-ae1b-d62ff91bf395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7a73fb-9f11-49cc-a01a-20382cc1c5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:26 devstack cinder-volume[92129]: DEBUG cinder.image.glance [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Creating Keystone auth plugin from conf {{(pid=92129) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:35:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7a73fb-9f11-49cc-a01a-20382cc1c5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ee414d4-0161-4059-9432-67b6a9fbf8d0', 'volume_name': 'volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0', 'volume_size': 1, 'image_id': 'a7f8dda1-fda1-4b6b-aebf-8cea47d016b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7f8dda1-fda1-4b6b-aebf-8cea47d016b7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c8ff0e963b8966f3e21cc5b648fa3bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ad3774e1c674a56a4243eae3bb12cc5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2adad50fb64d28f990003170e18f8c7d32b5ceeaf766c4472099b148611fc94d803664e3fd82dacfcf6bde9e88a9d8fa7cd3b6a2b6d3ef592fe3bedaef25b7aa', 'id': 'a7f8dda1-fda1-4b6b-aebf-8cea47d016b7', 'created_at': datetime.datetime(2026, 6, 15, 5, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7f8dda1-fda1-4b6b-aebf-8cea47d016b7/file', 'properties': {}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd0c003-3551-433b-a52e-db7346562a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd0c003-3551-433b-a52e-db7346562a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e47a6e-e411-49f5-bed4-fce3681c3d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:26 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Volume 4ee414d4-0161-4059-9432-67b6a9fbf8d0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0', 'volume_size': 1, 'image_id': 'a7f8dda1-fda1-4b6b-aebf-8cea47d016b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7f8dda1-fda1-4b6b-aebf-8cea47d016b7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c8ff0e963b8966f3e21cc5b648fa3bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ad3774e1c674a56a4243eae3bb12cc5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2adad50fb64d28f990003170e18f8c7d32b5ceeaf766c4472099b148611fc94d803664e3fd82dacfcf6bde9e88a9d8fa7cd3b6a2b6d3ef592fe3bedaef25b7aa', 'id': 'a7f8dda1-fda1-4b6b-aebf-8cea47d016b7', 'created_at': datetime.datetime(2026, 6, 15, 5, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7f8dda1-fda1-4b6b-aebf-8cea47d016b7/file', 'properties': {}}, 'image_service': } Jun 15 07:35:26 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Trying to clone 4ee414d4-0161-4059-9432-67b6a9fbf8d0 from image a7f8dda1-fda1-4b6b-aebf-8cea47d016b7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a7f8dda1-fda1-4b6b-aebf-8cea47d016b7', 'metadata': {}}]). {{(pid=92129) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:35:26 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:35:26 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Image download 0.00 MB at 0.00 MB/s Jun 15 07:35:26 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34dbb06-0d64-4863-b4ad-7493e49b893d]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:26 devstack sudo[110512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD Jun 15 07:35:26 devstack sudo[110512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:27 devstack sudo[110512]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD" returned: 0 in 0.657s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:27 devstack sudo[110516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD Jun 15 07:35:27 devstack sudo[110516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:28 devstack sudo[110516]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD" returned: 1 in 0.663s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:35:28 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Temporary image a7f8dda1-fda1-4b6b-aebf-8cea47d016b7 is fetched for user 0321d12cefc042bb9d1529c51491c918. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:35:28 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fa0a40-d78f-4710-86ca-2a19cd9f3f08]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:28 devstack sudo[110521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD Jun 15 07:35:28 devstack sudo[110521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:28 devstack sudo[110521]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD" returned: 0 in 0.658s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:28 devstack sudo[110525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD Jun 15 07:35:28 devstack sudo[110525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:29 devstack sudo[110525]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD" returned: 1 in 0.646s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:35:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee414d4-0161-4059-9432-67b6a9fbf8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ad3774e1c674a56a4243eae3bb12cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:26Z,use_quota=True,user_id='0321d12cefc042bb9d1529c51491c918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:35:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Creating volume 4ee414d4-0161-4059-9432-67b6a9fbf8d0 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:35:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:35:29 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:35:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:29 devstack sudo[110530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 1073741824 Jun 15 07:35:29 devstack sudo[110530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:30 devstack sudo[110530]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 1073741824" returned: 0 in 0.716s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:30 devstack sudo[110537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 Jun 15 07:35:30 devstack sudo[110537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:30 devstack sudo[110537]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0" returned: 0 in 0.568s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:30 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:35:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:30 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Attempting download of a7f8dda1-fda1-4b6b-aebf-8cea47d016b7 ((None, [{'url': 'file:///opt/stack/data/glance/images/a7f8dda1-fda1-4b6b-aebf-8cea47d016b7', 'metadata': {}}])) to volume 4ee414d4-0161-4059-9432-67b6a9fbf8d0. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:35:30 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f88abc-18bf-40db-a2dc-8881be05e6a0]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_rxadr5nt {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:31 devstack sudo[110540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_rxadr5nt Jun 15 07:35:31 devstack sudo[110540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:31 devstack sudo[110540]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_rxadr5nt" returned: 0 in 0.638s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_rxadr5nt {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:31 devstack sudo[110544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_rxadr5nt Jun 15 07:35:31 devstack sudo[110544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:32 devstack sudo[110544]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_rxadr5nt" returned: 1 in 0.667s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_rxadr5nt' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:35:32 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[30defbe2-ed84-4ab2-b0d2-5141ee5d02f2]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:32 devstack sudo[110548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD Jun 15 07:35:32 devstack sudo[110548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:32 devstack sudo[110548]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD" returned: 0 in 0.637s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:32 devstack sudo[110552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD Jun 15 07:35:32 devstack sudo[110552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:33 devstack sudo[110552]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD" returned: 1 in 0.642s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:35:33 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] a7f8dda1-fda1-4b6b-aebf-8cea47d016b7 was raw, converting to raw {{(pid=92129) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:35:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:33 devstack sudo[110557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 Jun 15 07:35:33 devstack sudo[110557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:34 devstack sudo[110557]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0" returned: 0 in 0.635s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:34 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a7f8dda1-fda1-4b6b-aebf-8cea47d016b7_exnwvyvydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:35:34 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Converted 0.00 MB image at 0.00 MB/s Jun 15 07:35:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:34 devstack sudo[110562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 1G Jun 15 07:35:34 devstack sudo[110562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:34 devstack sudo[110562]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 1G" returned: 0 in 0.592s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:34 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4c5d2a-5994-4895-9558-b51c6a9c1084]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:34 devstack sudo[110567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 Jun 15 07:35:34 devstack sudo[110567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:35 devstack sudo[110567]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0" returned: 0 in 0.670s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:35 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:35 devstack sudo[110571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 Jun 15 07:35:35 devstack sudo[110571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:36 devstack sudo[110571]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0" returned: 1 in 0.670s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:35:36 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Downloaded image a7f8dda1-fda1-4b6b-aebf-8cea47d016b7 ((None, [{'url': 'file:///opt/stack/data/glance/images/a7f8dda1-fda1-4b6b-aebf-8cea47d016b7', 'metadata': {}}])) to volume 4ee414d4-0161-4059-9432-67b6a9fbf8d0 successfully. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:35:36 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Temporary image a7f8dda1-fda1-4b6b-aebf-8cea47d016b7 for user 0321d12cefc042bb9d1529c51491c918 is deleted. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:35:36 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Marking volume 4ee414d4-0161-4059-9432-67b6a9fbf8d0 as bootable. {{(pid=92129) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:35:36 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Copying metadata from image a7f8dda1-fda1-4b6b-aebf-8cea47d016b7 to 4ee414d4-0161-4059-9432-67b6a9fbf8d0. {{(pid=92129) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:35:36 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Creating volume glance metadata for volume 4ee414d4-0161-4059-9432-67b6a9fbf8d0 backed by image a7f8dda1-fda1-4b6b-aebf-8cea47d016b7 with: {'image_id': 'a7f8dda1-fda1-4b6b-aebf-8cea47d016b7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8c8ff0e963b8966f3e21cc5b648fa3bd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92129) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:35:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e47a6e-e411-49f5-bed4-fce3681c3d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0', 'volume_size': 1, 'image_id': 'a7f8dda1-fda1-4b6b-aebf-8cea47d016b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7f8dda1-fda1-4b6b-aebf-8cea47d016b7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c8ff0e963b8966f3e21cc5b648fa3bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ad3774e1c674a56a4243eae3bb12cc5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2adad50fb64d28f990003170e18f8c7d32b5ceeaf766c4472099b148611fc94d803664e3fd82dacfcf6bde9e88a9d8fa7cd3b6a2b6d3ef592fe3bedaef25b7aa', 'id': 'a7f8dda1-fda1-4b6b-aebf-8cea47d016b7', 'created_at': datetime.datetime(2026, 6, 15, 5, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7f8dda1-fda1-4b6b-aebf-8cea47d016b7/file', 'properties': {}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8b3cba-e6ea-444b-9e85-9124e5e35c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:36 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Volume volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 (4ee414d4-0161-4059-9432-67b6a9fbf8d0): created successfully Jun 15 07:35:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8b3cba-e6ea-444b-9e85-9124e5e35c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:36 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Flow 'volume_create_manager' (8d6e4dae-bd11-473a-bad2-bfe18ab76bee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:36 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-17fbc814-f587-4e16-900a-1b6aa5d82453 tempest-VolumeImageDependencyTests-1410156923 None] Created volume successfully. Jun 15 07:35:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Acquiring lock "cinder-4ee414d4-0161-4059-9432-67b6a9fbf8d0-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Lock "cinder-4ee414d4-0161-4059-9432-67b6a9fbf8d0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Acquiring lock "cinder-quobyte-4ee414d4-0161-4059-9432-67b6a9fbf8d0" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Lock "cinder-quobyte-4ee414d4-0161-4059-9432-67b6a9fbf8d0" acquired by "delete_volume" :: waited 0.015s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:37 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36db913-0c84-4b9e-a7e7-ed55f396adbd]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:37 devstack sudo[110576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 Jun 15 07:35:37 devstack sudo[110576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:37 devstack sudo[110576]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0" returned: 0 in 0.692s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:37 devstack sudo[110580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 Jun 15 07:35:37 devstack sudo[110580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:38 devstack sudo[110580]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0" returned: 1 in 0.679s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:35:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:38 devstack sudo[110585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0 Jun 15 07:35:38 devstack sudo[110585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:39 devstack sudo[110585]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-4ee414d4-0161-4059-9432-67b6a9fbf8d0" returned: 0 in 0.559s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Lock "cinder-quobyte-4ee414d4-0161-4059-9432-67b6a9fbf8d0" released by "delete_volume" :: held 1.983s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:39 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Created reservations ['a0a784b0-fe4a-43ff-892e-4df8606c1c2a', '2cc34fb8-0c0e-4129-9433-1c2ff9e672c2', '06a32564-41c7-4a7a-8034-6d9d191d25bc', '385dc481-7bef-4ec6-8778-af1dc05db5d4'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:35:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:39 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:39 devstack sudo[110589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:35:39 devstack sudo[110589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:39 devstack sudo[110589]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.607s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:39 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:39 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Deleted volume successfully. Jun 15 07:35:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f2ecd055-1eb8-4b49-ae96-1e1ae6d809d5 tempest-VolumeImageDependencyTests-1410156923 None] Lock "cinder-4ee414d4-0161-4059-9432-67b6a9fbf8d0-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:49 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:UPDATE=90,cinder:SELECT=66,cinder:INSERT=24,cinder:DELETE=9 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Flow 'volume_create_manager' (62293723-6631-4115-9e3f-30a21be6d2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0964e44c-027f-4e76-9643-1042dca570d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0964e44c-027f-4e76-9643-1042dca570d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-616975086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85288128-3972-411f-a9f0-21ff406d0067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af3e42ba3bc4029a4c66a1d13850205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:51Z,use_quota=True,user_id='cd9f7ad12e0340b7bb024288e4653e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6d2b91-29a4-4821-b82e-f7a4e1ead3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6d2b91-29a4-4821-b82e-f7a4e1ead3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b77bf3-d95b-4a45-a371-15b095796b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b77bf3-d95b-4a45-a371-15b095796b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85288128-3972-411f-a9f0-21ff406d0067', 'volume_name': 'volume-85288128-3972-411f-a9f0-21ff406d0067', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e02d98-2d0a-4a52-a1dc-a6ac23c75935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e02d98-2d0a-4a52-a1dc-a6ac23c75935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe40251-4265-46b4-9cc1-f349a20c8917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume 85288128-3972-411f-a9f0-21ff406d0067: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85288128-3972-411f-a9f0-21ff406d0067', 'volume_size': 1} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-616975086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85288128-3972-411f-a9f0-21ff406d0067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af3e42ba3bc4029a4c66a1d13850205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:51Z,use_quota=True,user_id='cd9f7ad12e0340b7bb024288e4653e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Creating volume 85288128-3972-411f-a9f0-21ff406d0067 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:35:51 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:51 devstack sudo[110672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067 1073741824 Jun 15 07:35:51 devstack sudo[110672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Flow 'volume_create_manager' (6c68ae41-e483-4014-82a9-c1c7065b5eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a59b6f-605e-4f5c-bbba-efee43a2e56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a59b6f-605e-4f5c-bbba-efee43a2e56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1661914744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6401f26-9c72-4f46-a4b7-872662c3b582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f007ee4d29c04b4a98c8b9c16adb2d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:51Z,use_quota=True,user_id='e6b089dd22f148a6b5352b000adc7816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc3886b-7ec8-4a42-9a66-0c72f2750dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc3886b-7ec8-4a42-9a66-0c72f2750dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f7e38a-8924-4ac6-b869-558cf196d26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f7e38a-8924-4ac6-b869-558cf196d26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6401f26-9c72-4f46-a4b7-872662c3b582', 'volume_name': 'volume-c6401f26-9c72-4f46-a4b7-872662c3b582', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f611e7-6e4b-4530-a5cf-d5f75dd79714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f611e7-6e4b-4530-a5cf-d5f75dd79714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33ea8f4-c1d9-4b23-8e75-e16cd0fecbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Volume c6401f26-9c72-4f46-a4b7-872662c3b582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6401f26-9c72-4f46-a4b7-872662c3b582', 'volume_size': 1} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Flow 'volume_create_manager' (5c5da983-462a-4d0c-8593-563e5e852389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9406f19f-8c7f-493e-b120-7fe9bbae705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9406f19f-8c7f-493e-b120-7fe9bbae705f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1412765505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4470042-4cfa-4b17-ae5b-9dc8011d7f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f007ee4d29c04b4a98c8b9c16adb2d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:52Z,use_quota=True,user_id='e6b089dd22f148a6b5352b000adc7816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8698141-7a63-4afb-a462-779e553b6216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8698141-7a63-4afb-a462-779e553b6216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2e1ddb-f44f-4037-9c62-bcda287945bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2e1ddb-f44f-4037-9c62-bcda287945bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4470042-4cfa-4b17-ae5b-9dc8011d7f21', 'volume_name': 'volume-b4470042-4cfa-4b17-ae5b-9dc8011d7f21', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c16af3-ed8c-438a-942a-910391a0c230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c16af3-ed8c-438a-942a-910391a0c230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65333a5-df6c-4349-aa0e-241e76aa61cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Volume b4470042-4cfa-4b17-ae5b-9dc8011d7f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4470042-4cfa-4b17-ae5b-9dc8011d7f21', 'volume_size': 1} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Flow 'volume_create_manager' (61f534e1-2fff-40ee-9323-31aa8f2a3c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6dda6e9-ce30-4752-8aaa-d067925cde27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6dda6e9-ce30-4752-8aaa-d067925cde27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-834477635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a176bd-f0b8-4f6e-81fe-4fad9989e6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf42b3ca24d4cc3bb0a823075ed8b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:52Z,use_quota=True,user_id='a7492f92532f4d2da6a0d58fbddcd830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd063fb-8547-42e5-ad0b-ded1e6c8182d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd063fb-8547-42e5-ad0b-ded1e6c8182d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370e2108-2b2d-466f-9cd9-9afc6e319521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370e2108-2b2d-466f-9cd9-9afc6e319521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62a176bd-f0b8-4f6e-81fe-4fad9989e6f3', 'volume_name': 'volume-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493ec002-01a6-4e9c-9be0-317f4a12d32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493ec002-01a6-4e9c-9be0-317f4a12d32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04b18c0-1aa8-4633-bcb0-1bd0458e16ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:51 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume 62a176bd-f0b8-4f6e-81fe-4fad9989e6f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3', 'volume_size': 1} Jun 15 07:35:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Flow 'volume_create_manager' (c32ec9d0-acca-4f57-8745-a904cb45e022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d93a2e8d-1adf-411e-9972-5ad62b68f829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d93a2e8d-1adf-411e-9972-5ad62b68f829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1341065152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de9aff2-a623-4443-9bc7-d05574815e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f007ee4d29c04b4a98c8b9c16adb2d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:52Z,use_quota=True,user_id='e6b089dd22f148a6b5352b000adc7816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab43639f-fd7b-4680-8a2f-2f972327bf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab43639f-fd7b-4680-8a2f-2f972327bf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37c573f-2e92-4afa-bc9b-a14005f1ab65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37c573f-2e92-4afa-bc9b-a14005f1ab65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1de9aff2-a623-4443-9bc7-d05574815e0d', 'volume_name': 'volume-1de9aff2-a623-4443-9bc7-d05574815e0d', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f19197-4a6e-4162-91a3-eab6a074460d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f19197-4a6e-4162-91a3-eab6a074460d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3706813d-fc18-4f7e-8df5-89ac41c0b1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:52 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Volume 1de9aff2-a623-4443-9bc7-d05574815e0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1de9aff2-a623-4443-9bc7-d05574815e0d', 'volume_size': 1} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:52 devstack sudo[110672]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067 1073741824" returned: 0 in 1.048s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:52 devstack sudo[110678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067 Jun 15 07:35:52 devstack sudo[110678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Flow 'volume_create_manager' (937671b2-fcb6-452c-9658-e806783508bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb00d27c-c5e6-4cc0-b316-4b83e7ff3200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb00d27c-c5e6-4cc0-b316-4b83e7ff3200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-245090018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0e4cba-d422-410d-b678-519a916147df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f007ee4d29c04b4a98c8b9c16adb2d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:53Z,use_quota=True,user_id='e6b089dd22f148a6b5352b000adc7816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31443285-6438-482b-88fa-0c71529f6bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31443285-6438-482b-88fa-0c71529f6bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaaba948-0b5b-43eb-bd97-3d9a5580248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaaba948-0b5b-43eb-bd97-3d9a5580248e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f0e4cba-d422-410d-b678-519a916147df', 'volume_name': 'volume-7f0e4cba-d422-410d-b678-519a916147df', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1626dd-8472-45fe-8a59-fe307ff50844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1626dd-8472-45fe-8a59-fe307ff50844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d42e2a08-0462-4860-a10e-91f7a72b0a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:52 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Volume 7f0e4cba-d422-410d-b678-519a916147df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f0e4cba-d422-410d-b678-519a916147df', 'volume_size': 1} Jun 15 07:35:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Flow 'volume_create_manager' (23f801f9-5841-4dbe-ac80-890ecfe192f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db51760d-0e99-426f-afe4-c545be4fa63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db51760d-0e99-426f-afe4-c545be4fa63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-439459703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f92b1ed7-1012-4e20-8841-f26cf7f9a8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f007ee4d29c04b4a98c8b9c16adb2d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:53Z,use_quota=True,user_id='e6b089dd22f148a6b5352b000adc7816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7290e082-68ab-46f8-8458-80e3032853c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7290e082-68ab-46f8-8458-80e3032853c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b1b675-d0b7-4510-a28f-03a49df6e0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b1b675-d0b7-4510-a28f-03a49df6e0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f92b1ed7-1012-4e20-8841-f26cf7f9a8b8', 'volume_name': 'volume-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b948a05-2565-44d7-8c4f-97f634c60493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b948a05-2565-44d7-8c4f-97f634c60493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13f316e-5679-4381-8c2a-47633b0cd8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:53 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Volume f92b1ed7-1012-4e20-8841-f26cf7f9a8b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8', 'volume_size': 1} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:53 devstack sudo[110678]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067" returned: 0 in 0.698s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.617s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1661914744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6401f26-9c72-4f46-a4b7-872662c3b582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f007ee4d29c04b4a98c8b9c16adb2d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:51Z,use_quota=True,user_id='e6b089dd22f148a6b5352b000adc7816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Creating volume c6401f26-9c72-4f46-a4b7-872662c3b582 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:35:53 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6401f26-9c72-4f46-a4b7-872662c3b582 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe40251-4265-46b4-9cc1-f349a20c8917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85288128-3972-411f-a9f0-21ff406d0067', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:53 devstack sudo[110681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6401f26-9c72-4f46-a4b7-872662c3b582 1073741824 Jun 15 07:35:53 devstack sudo[110681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f8e058-8901-4e69-8cfc-e9d344e0e960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:53 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume volume-85288128-3972-411f-a9f0-21ff406d0067 (85288128-3972-411f-a9f0-21ff406d0067): created successfully Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f8e058-8901-4e69-8cfc-e9d344e0e960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Flow 'volume_create_manager' (62293723-6631-4115-9e3f-30a21be6d2e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:53 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-097e3914-a5da-47df-aea1-f5106b75f5d6 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Created volume successfully. Jun 15 07:35:53 devstack sudo[110681]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6401f26-9c72-4f46-a4b7-872662c3b582 1073741824" returned: 0 in 0.784s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6401f26-9c72-4f46-a4b7-872662c3b582 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:54 devstack sudo[110687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6401f26-9c72-4f46-a4b7-872662c3b582 Jun 15 07:35:54 devstack sudo[110687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:54 devstack sudo[110687]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6401f26-9c72-4f46-a4b7-872662c3b582" returned: 0 in 0.637s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.911s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1412765505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4470042-4cfa-4b17-ae5b-9dc8011d7f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f007ee4d29c04b4a98c8b9c16adb2d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:52Z,use_quota=True,user_id='e6b089dd22f148a6b5352b000adc7816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Creating volume b4470042-4cfa-4b17-ae5b-9dc8011d7f21 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:35:54 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b4470042-4cfa-4b17-ae5b-9dc8011d7f21 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:54 devstack sudo[110690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b4470042-4cfa-4b17-ae5b-9dc8011d7f21 1073741824 Jun 15 07:35:54 devstack sudo[110690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33ea8f4-c1d9-4b23-8e75-e16cd0fecbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6401f26-9c72-4f46-a4b7-872662c3b582', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b702138-bb8b-4fb9-b1eb-926e0809618a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:54 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Volume volume-c6401f26-9c72-4f46-a4b7-872662c3b582 (c6401f26-9c72-4f46-a4b7-872662c3b582): created successfully Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b702138-bb8b-4fb9-b1eb-926e0809618a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Flow 'volume_create_manager' (6c68ae41-e483-4014-82a9-c1c7065b5eaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:54 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-5566efe5-bda7-46ca-ba51-1535f708f7d3 tempest-CreateVolumesFromImageTest-1271911322 None] Created volume successfully. Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Flow 'volume_create_manager' (0b311a36-56e0-4fbd-8c02-04d8cbc157d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e18328-7ab0-4db5-96d6-55d76a492d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e18328-7ab0-4db5-96d6-55d76a492d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ce47ea-fce5-48ab-81d1-afc00ac0105b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3afc07d2f55a48f6909cdcbcdbbe930d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:55Z,use_quota=True,user_id='95e274bd33ce4bd98848c1039ea9c409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f92c0855-06c0-4ae1-9d24-ac851da972d8),volume_type_id=f92c0855-06c0-4ae1-9d24-ac851da972d8)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5bd2aa-856b-4cb6-8ec1-5ce00f8051eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5bd2aa-856b-4cb6-8ec1-5ce00f8051eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5904bbf4-0a35-4187-bab4-bdf04dcc0fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:55 devstack cinder-volume[92129]: DEBUG cinder.image.glance [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Creating Keystone auth plugin from conf {{(pid=92129) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:35:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5904bbf4-0a35-4187-bab4-bdf04dcc0fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f4ce47ea-fce5-48ab-81d1-afc00ac0105b', 'volume_name': 'volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b', 'volume_size': 1, 'image_id': '84b8738f-12ad-4797-992f-aa42f77e296d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84b8738f-12ad-4797-992f-aa42f77e296d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9e32b6751f7f71273d64b11eca57d7ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3afc07d2f55a48f6909cdcbcdbbe930d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4d8ffc9317254b64c99c93aa7aaefe7c71f171c48fd06e8382f84fd01e774d6642b30f6e4124ae36c0b90b2841c88e4225184f63262902c84522b2d148ab85c5', 'id': '84b8738f-12ad-4797-992f-aa42f77e296d', 'created_at': datetime.datetime(2026, 6, 15, 5, 35, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 35, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8738f-12ad-4797-992f-aa42f77e296d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59b4787-7f50-47ec-b6ff-7aff8452957a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59b4787-7f50-47ec-b6ff-7aff8452957a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:55 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15af4458-a17b-4467-8392-a1b6768dc06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:55 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Volume f4ce47ea-fce5-48ab-81d1-afc00ac0105b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b', 'volume_size': 1, 'image_id': '84b8738f-12ad-4797-992f-aa42f77e296d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84b8738f-12ad-4797-992f-aa42f77e296d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9e32b6751f7f71273d64b11eca57d7ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3afc07d2f55a48f6909cdcbcdbbe930d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4d8ffc9317254b64c99c93aa7aaefe7c71f171c48fd06e8382f84fd01e774d6642b30f6e4124ae36c0b90b2841c88e4225184f63262902c84522b2d148ab85c5', 'id': '84b8738f-12ad-4797-992f-aa42f77e296d', 'created_at': datetime.datetime(2026, 6, 15, 5, 35, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 35, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8738f-12ad-4797-992f-aa42f77e296d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 15 07:35:55 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Trying to clone f4ce47ea-fce5-48ab-81d1-afc00ac0105b from image 84b8738f-12ad-4797-992f-aa42f77e296d at location (None, [{'url': 'file:///opt/stack/data/glance/images/84b8738f-12ad-4797-992f-aa42f77e296d', 'metadata': {}}]). {{(pid=92129) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:35:55 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:35:55 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Image download 0.00 MB at 0.00 MB/s Jun 15 07:35:55 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7779b2b4-cc81-42d6-9e4e-596ae1588c72]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:55 devstack sudo[110690]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b4470042-4cfa-4b17-ae5b-9dc8011d7f21 1073741824" returned: 0 in 0.859s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b4470042-4cfa-4b17-ae5b-9dc8011d7f21 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:55 devstack sudo[110697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD Jun 15 07:35:55 devstack sudo[110697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:55 devstack sudo[110698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b4470042-4cfa-4b17-ae5b-9dc8011d7f21 Jun 15 07:35:55 devstack sudo[110698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:56 devstack sudo[110698]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b4470042-4cfa-4b17-ae5b-9dc8011d7f21" returned: 0 in 0.589s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:56 devstack sudo[110697]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.159s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-834477635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a176bd-f0b8-4f6e-81fe-4fad9989e6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf42b3ca24d4cc3bb0a823075ed8b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:52Z,use_quota=True,user_id='a7492f92532f4d2da6a0d58fbddcd830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Creating volume 62a176bd-f0b8-4f6e-81fe-4fad9989e6f3 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:35:56 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD" returned: 0 in 0.712s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:56 devstack sudo[110704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3 1073741824 Jun 15 07:35:56 devstack sudo[110704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65333a5-df6c-4349-aa0e-241e76aa61cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4470042-4cfa-4b17-ae5b-9dc8011d7f21', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451a76b7-c711-42db-bcad-57100685153d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:56 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Volume volume-b4470042-4cfa-4b17-ae5b-9dc8011d7f21 (b4470042-4cfa-4b17-ae5b-9dc8011d7f21): created successfully Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451a76b7-c711-42db-bcad-57100685153d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Flow 'volume_create_manager' (5c5da983-462a-4d0c-8593-563e5e852389) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:56 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f3425fdc-1a06-4997-8aa7-d6672b3ca40a tempest-CreateVolumesFromImageTest-1271911322 None] Created volume successfully. Jun 15 07:35:56 devstack sudo[110705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD Jun 15 07:35:56 devstack sudo[110705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:56 devstack sudo[110705]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD" returned: 1 in 0.685s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Temporary image 84b8738f-12ad-4797-992f-aa42f77e296d is fetched for user 95e274bd33ce4bd98848c1039ea9c409. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8097b807-15a6-4398-890b-a14f5a7f5403]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:56 devstack sudo[110704]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3 1073741824" returned: 0 in 0.779s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:56 devstack sudo[110715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3 Jun 15 07:35:56 devstack sudo[110715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:57 devstack sudo[110714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD Jun 15 07:35:57 devstack sudo[110714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:57 devstack sudo[110715]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3" returned: 0 in 0.599s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.192s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1341065152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de9aff2-a623-4443-9bc7-d05574815e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f007ee4d29c04b4a98c8b9c16adb2d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:52Z,use_quota=True,user_id='e6b089dd22f148a6b5352b000adc7816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Creating volume 1de9aff2-a623-4443-9bc7-d05574815e0d {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:57 devstack sudo[110714]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:35:57 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1de9aff2-a623-4443-9bc7-d05574815e0d 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD" returned: 0 in 0.686s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:57 devstack sudo[110721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1de9aff2-a623-4443-9bc7-d05574815e0d 1073741824 Jun 15 07:35:57 devstack sudo[110721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04b18c0-1aa8-4633-bcb0-1bd0458e16ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1dbb78-276b-4dbd-9638-a2eb9f2db162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:57 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume volume-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3 (62a176bd-f0b8-4f6e-81fe-4fad9989e6f3): created successfully Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1dbb78-276b-4dbd-9638-a2eb9f2db162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:57 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Flow 'volume_create_manager' (61f534e1-2fff-40ee-9323-31aa8f2a3c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:57 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-344032bf-db97-4fe0-8293-bee509e08742 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Created volume successfully. Jun 15 07:35:57 devstack sudo[110722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD Jun 15 07:35:57 devstack sudo[110722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:58 devstack sudo[110722]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD" returned: 1 in 0.692s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:35:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:58 devstack sudo[110721]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1de9aff2-a623-4443-9bc7-d05574815e0d 1073741824" returned: 0 in 0.786s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1de9aff2-a623-4443-9bc7-d05574815e0d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:58 devstack sudo[110732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1de9aff2-a623-4443-9bc7-d05574815e0d Jun 15 07:35:58 devstack sudo[110732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:58 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Flow 'volume_create_manager' (2ed2eb4a-37d4-4186-b7c5-d399eb1bdbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (205514e3-b11d-4975-9d77-3cc485ac86bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (205514e3-b11d-4975-9d77-3cc485ac86bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-159967169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632548d9-0212-4ace-b4b9-d45526f519ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf42b3ca24d4cc3bb0a823075ed8b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:59Z,use_quota=True,user_id='a7492f92532f4d2da6a0d58fbddcd830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d58659a-037e-4709-b300-86ff7f6a16c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d58659a-037e-4709-b300-86ff7f6a16c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61772b5c-b6f6-4bd9-b7be-3f85e76a44d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61772b5c-b6f6-4bd9-b7be-3f85e76a44d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '632548d9-0212-4ace-b4b9-d45526f519ce', 'volume_name': 'volume-632548d9-0212-4ace-b4b9-d45526f519ce', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5210f319-86ec-48b4-8f24-24eae253e32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5210f319-86ec-48b4-8f24-24eae253e32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109e0a05-c489-47ce-baf9-8ea9f2d806ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:58 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume 632548d9-0212-4ace-b4b9-d45526f519ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-632548d9-0212-4ace-b4b9-d45526f519ce', 'volume_size': 1} Jun 15 07:35:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:59 devstack sudo[110732]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1de9aff2-a623-4443-9bc7-d05574815e0d" returned: 0 in 0.620s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.248s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-245090018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0e4cba-d422-410d-b678-519a916147df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f007ee4d29c04b4a98c8b9c16adb2d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:53Z,use_quota=True,user_id='e6b089dd22f148a6b5352b000adc7816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Creating volume 7f0e4cba-d422-410d-b678-519a916147df {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:35:59 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7f0e4cba-d422-410d-b678-519a916147df 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:59 devstack sudo[110735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7f0e4cba-d422-410d-b678-519a916147df 1073741824 Jun 15 07:35:59 devstack sudo[110735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Flow 'volume_create_manager' (4eed78f0-fa73-4b11-8046-d6477e82c32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3528570f-e4d2-42fb-840c-a784df5da894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3706813d-fc18-4f7e-8df5-89ac41c0b1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1de9aff2-a623-4443-9bc7-d05574815e0d', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58876943-ccc9-42f2-8216-13b15ccafedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3528570f-e4d2-42fb-840c-a784df5da894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1876221639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf42b3ca24d4cc3bb0a823075ed8b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:59Z,use_quota=True,user_id='a7492f92532f4d2da6a0d58fbddcd830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea817ac-3f40-4554-9fff-7be72e909317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea817ac-3f40-4554-9fff-7be72e909317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fdce19d-b20b-4aa0-99c0-a6fcedc834f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fdce19d-b20b-4aa0-99c0-a6fcedc834f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c', 'volume_name': 'volume-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e0afd0-b293-49f6-b0f2-be6571a2ada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e0afd0-b293-49f6-b0f2-be6571a2ada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d7e30a-9d10-4da3-b588-e3c19691fc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:59 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume 57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c', 'volume_size': 1} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:59 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Volume volume-1de9aff2-a623-4443-9bc7-d05574815e0d (1de9aff2-a623-4443-9bc7-d05574815e0d): created successfully Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58876943-ccc9-42f2-8216-13b15ccafedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Flow 'volume_create_manager' (c32ec9d0-acca-4f57-8745-a904cb45e022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:59 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0fcfdee1-c66c-4051-ad37-c41e2e89b2a8 tempest-CreateVolumesFromImageTest-1271911322 None] Created volume successfully. Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Flow 'volume_create_manager' (edd7d9b1-72bc-4cd9-8df7-70d63063a06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05adfec2-e55d-4754-a3f5-71f2ca8c23dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05adfec2-e55d-4754-a3f5-71f2ca8c23dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1914292504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a026ee78-87cf-4881-adf5-e667b89da9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf42b3ca24d4cc3bb0a823075ed8b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:59Z,use_quota=True,user_id='a7492f92532f4d2da6a0d58fbddcd830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029fc546-7be6-402e-bda3-9983c75ca188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029fc546-7be6-402e-bda3-9983c75ca188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f7b651-44a2-4d26-8af8-01177383ba28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f7b651-44a2-4d26-8af8-01177383ba28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a026ee78-87cf-4881-adf5-e667b89da9b3', 'volume_name': 'volume-a026ee78-87cf-4881-adf5-e667b89da9b3', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b8589b-829c-4a36-8530-8091e6ecedfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b8589b-829c-4a36-8530-8091e6ecedfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27c1028-2510-46a2-9a1a-6f1553054b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:59 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume a026ee78-87cf-4881-adf5-e667b89da9b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a026ee78-87cf-4881-adf5-e667b89da9b3', 'volume_size': 1} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Flow 'volume_create_manager' (5f8e9be6-3f72-45a4-b78a-4288880071d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3051bcdd-d8e0-4d8c-97e0-93da4004c3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3051bcdd-d8e0-4d8c-97e0-93da4004c3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-165317515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5faf0808-a2e3-4bb3-8284-d648117b35f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf42b3ca24d4cc3bb0a823075ed8b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:00Z,use_quota=True,user_id='a7492f92532f4d2da6a0d58fbddcd830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc90986-0241-461d-b2e5-a9a7adf767a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc90986-0241-461d-b2e5-a9a7adf767a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ddd968-39ac-46ad-aabf-9673245a874b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ddd968-39ac-46ad-aabf-9673245a874b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5faf0808-a2e3-4bb3-8284-d648117b35f0', 'volume_name': 'volume-5faf0808-a2e3-4bb3-8284-d648117b35f0', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a819b4-a5b7-46a9-ae86-a171f5d8bd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a819b4-a5b7-46a9-ae86-a171f5d8bd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65533bdb-c8a1-4648-a729-59e218b94b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:59 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume 5faf0808-a2e3-4bb3-8284-d648117b35f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5faf0808-a2e3-4bb3-8284-d648117b35f0', 'volume_size': 1} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:59 devstack sudo[110735]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7f0e4cba-d422-410d-b678-519a916147df 1073741824" returned: 0 in 0.925s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7f0e4cba-d422-410d-b678-519a916147df {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:00 devstack sudo[110742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7f0e4cba-d422-410d-b678-519a916147df Jun 15 07:36:00 devstack sudo[110742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Flow 'volume_create_manager' (6f0109cd-87c3-4d76-89ae-522f780bf4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16599d8e-1726-4534-9737-fe6df70f12ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16599d8e-1726-4534-9737-fe6df70f12ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2116988689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f1f9cb1-751a-4b1c-9bf3-581133823ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf42b3ca24d4cc3bb0a823075ed8b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:00Z,use_quota=True,user_id='a7492f92532f4d2da6a0d58fbddcd830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0924d0d8-99c0-4c43-8f18-72c8ffdd0d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0924d0d8-99c0-4c43-8f18-72c8ffdd0d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c8593b-2b04-4551-804b-423130fba386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c8593b-2b04-4551-804b-423130fba386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f1f9cb1-751a-4b1c-9bf3-581133823ab0', 'volume_name': 'volume-1f1f9cb1-751a-4b1c-9bf3-581133823ab0', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8489a956-62f8-42b2-91d7-eef56606d6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8489a956-62f8-42b2-91d7-eef56606d6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b9c101-3087-4a59-bae7-f43db64bb710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:00 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume 1f1f9cb1-751a-4b1c-9bf3-581133823ab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f1f9cb1-751a-4b1c-9bf3-581133823ab0', 'volume_size': 1} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:00 devstack sudo[110742]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7f0e4cba-d422-410d-b678-519a916147df" returned: 0 in 0.623s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.495s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-439459703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f92b1ed7-1012-4e20-8841-f26cf7f9a8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f007ee4d29c04b4a98c8b9c16adb2d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:53Z,use_quota=True,user_id='e6b089dd22f148a6b5352b000adc7816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Creating volume f92b1ed7-1012-4e20-8841-f26cf7f9a8b8 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:00 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d42e2a08-0462-4860-a10e-91f7a72b0a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f0e4cba-d422-410d-b678-519a916147df', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:00 devstack sudo[110745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8 1073741824 Jun 15 07:36:00 devstack sudo[110745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4b7cff-2b87-440e-be8a-f383470cf92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:00 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Volume volume-7f0e4cba-d422-410d-b678-519a916147df (7f0e4cba-d422-410d-b678-519a916147df): created successfully Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4b7cff-2b87-440e-be8a-f383470cf92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:00 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Flow 'volume_create_manager' (937671b2-fcb6-452c-9658-e806783508bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:00 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-7dc2c0bd-99f1-482f-b7db-279e780da698 tempest-CreateVolumesFromImageTest-1271911322 None] Created volume successfully. Jun 15 07:36:01 devstack sudo[110745]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8 1073741824" returned: 0 in 0.794s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:01 devstack sudo[110752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8 Jun 15 07:36:01 devstack sudo[110752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:02 devstack sudo[110752]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8" returned: 0 in 0.610s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.509s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:02 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Creating offline snapshot b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a of volume 85288128-3972-411f-a9f0-21ff406d0067 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:36:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13f316e-5679-4381-8c2a-47633b0cd8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d53eb27-5b62-4ae9-a3bc-359c4531841e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:02 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b33b52f-a813-4065-926d-009f90703bd8]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:02 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Volume volume-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8 (f92b1ed7-1012-4e20-8841-f26cf7f9a8b8): created successfully Jun 15 07:36:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d53eb27-5b62-4ae9-a3bc-359c4531841e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:02 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Flow 'volume_create_manager' (23f801f9-5841-4dbe-ac80-890ecfe192f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:02 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-cb9ce540-34f3-45a0-bdf3-5c4be5d0dd09 tempest-CreateVolumesFromImageTest-1271911322 None] Created volume successfully. Jun 15 07:36:02 devstack sudo[110755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067 Jun 15 07:36:02 devstack sudo[110755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:02 devstack sudo[110755]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067" returned: 0 in 0.759s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:02 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "cinder-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:02 devstack sudo[110760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a 1G Jun 15 07:36:02 devstack sudo[110760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:02 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:02 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "cinder-quobyte-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:02 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-quobyte-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8" acquired by "delete_volume" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:03 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[095d0d21-11ad-456c-8ea0-b5c2f173d252]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:03 devstack sudo[110762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8 Jun 15 07:36:03 devstack sudo[110762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:03 devstack sudo[110760]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a 1G" returned: 0 in 0.810s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85288128-3972-411f-a9f0-21ff406d0067 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:03 devstack sudo[110770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85288128-3972-411f-a9f0-21ff406d0067 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a Jun 15 07:36:03 devstack sudo[110770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:03 devstack sudo[110762]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8" returned: 0 in 0.697s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:03 devstack sudo[110772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8 Jun 15 07:36:03 devstack sudo[110772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:04 devstack sudo[110772]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8" returned: 0 in 0.571s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-quobyte-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8" released by "delete_volume" :: held 1.314s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:04 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=92,cinder:UPDATE=123,cinder:DELETE=9,cinder:INSERT=34 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:36:04 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] Created reservations ['940a6e71-0841-4083-bff4-3e1bde16b661', 'ba805827-1c11-4b3b-b73b-78b9ee21544f', 'a5d2cd0a-8c7e-437a-825c-519e7cb0b267', 'e9f35d55-f1de-46ab-8789-759342a40951'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:04 devstack sudo[110770]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85288128-3972-411f-a9f0-21ff406d0067 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a" returned: 0 in 0.688s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:04 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a is being set with open permissions: ugo+rw Jun 15 07:36:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:04 devstack sudo[110778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a Jun 15 07:36:04 devstack sudo[110778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:04 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:04 devstack sudo[110780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:04 devstack sudo[110780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:04 devstack sudo[110778]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a" returned: 0 in 0.591s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:05 devstack sudo[110780]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.576s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:05 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:05 devstack sudo[110784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.info Jun 15 07:36:05 devstack sudo[110784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:05 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] Deleted volume successfully. Jun 15 07:36:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-34b9d2a9-ca3e-4ad9-8372-efc5308f075d tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-f92b1ed7-1012-4e20-8841-f26cf7f9a8b8-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "cinder-7f0e4cba-d422-410d-b678-519a916147df-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-7f0e4cba-d422-410d-b678-519a916147df-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "cinder-quobyte-7f0e4cba-d422-410d-b678-519a916147df" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-quobyte-7f0e4cba-d422-410d-b678-519a916147df" acquired by "delete_volume" :: waited 0.015s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:05 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96b8934-d16c-418b-8572-0f37c223859c]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7f0e4cba-d422-410d-b678-519a916147df {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:05 devstack sudo[110786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7f0e4cba-d422-410d-b678-519a916147df Jun 15 07:36:05 devstack sudo[110786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:05 devstack sudo[110784]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.info" returned: 0 in 0.589s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:05 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.info is being set with open permissions: ugo+rw Jun 15 07:36:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:05 devstack sudo[110789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.info Jun 15 07:36:05 devstack sudo[110789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:05 devstack sudo[110786]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7f0e4cba-d422-410d-b678-519a916147df" returned: 0 in 0.714s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7f0e4cba-d422-410d-b678-519a916147df {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:05 devstack sudo[110794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7f0e4cba-d422-410d-b678-519a916147df Jun 15 07:36:05 devstack sudo[110794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:06 devstack sudo[110789]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.info" returned: 0 in 0.580s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.118s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.898s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ce47ea-fce5-48ab-81d1-afc00ac0105b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3afc07d2f55a48f6909cdcbcdbbe930d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:55Z,use_quota=True,user_id='95e274bd33ce4bd98848c1039ea9c409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f92c0855-06c0-4ae1-9d24-ac851da972d8),volume_type_id=f92c0855-06c0-4ae1-9d24-ac851da972d8)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Creating volume f4ce47ea-fce5-48ab-81d1-afc00ac0105b {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:06 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:06 devstack sudo[110797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b 1073741824 Jun 15 07:36:06 devstack sudo[110797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:06 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-35e29522-f583-4edc-b4f6-8ced709f3f7e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Create snapshot completed successfully Jun 15 07:36:06 devstack sudo[110794]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7f0e4cba-d422-410d-b678-519a916147df" returned: 0 in 0.634s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-quobyte-7f0e4cba-d422-410d-b678-519a916147df" released by "delete_volume" :: held 1.392s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] Created reservations ['0b2f683e-2540-430f-93a5-f59067f032e2', 'ee594c55-ebcd-44c7-ac83-227bf9ebc482', '69d917c2-55b1-4f59-a876-7e1a766622f0', '75d9fb46-496a-4cb3-ade9-9efd603d270f'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:06 devstack sudo[110802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:06 devstack sudo[110802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:07 devstack sudo[110797]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b 1073741824" returned: 0 in 0.826s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:07 devstack sudo[110805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b Jun 15 07:36:07 devstack sudo[110805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:07 devstack sudo[110802]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.617s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:07 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] Deleted volume successfully. Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f7dd3421-6118-4602-bec0-fb3cf2d1216a tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-7f0e4cba-d422-410d-b678-519a916147df-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "cinder-1de9aff2-a623-4443-9bc7-d05574815e0d-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-1de9aff2-a623-4443-9bc7-d05574815e0d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Flow 'volume_create_manager' (37aa9001-181d-4da0-8ae5-6422796f8c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3647fcd-7f49-41b8-bd47-4d0622a212c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3647fcd-7f49-41b8-bd47-4d0622a212c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1492345648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f11ef2-b170-4a4a-a43b-c3c8bb2ff238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af3e42ba3bc4029a4c66a1d13850205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:07Z,use_quota=True,user_id='cd9f7ad12e0340b7bb024288e4653e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c654cd46-d8c3-4f9c-9920-e1d106d99990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c654cd46-d8c3-4f9c-9920-e1d106d99990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b3a3d2-7fec-41d9-87d2-e602cb1a4129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b3a3d2-7fec-41d9-87d2-e602cb1a4129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46f11ef2-b170-4a4a-a43b-c3c8bb2ff238', 'volume_name': 'volume-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a65e103-cd7b-41f8-9c62-21752a5b6764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a65e103-cd7b-41f8-9c62-21752a5b6764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db95005f-77ec-403f-8eb5-f90d21c03cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:07 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume 46f11ef2-b170-4a4a-a43b-c3c8bb2ff238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238', 'volume_size': 1} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "cinder-quobyte-1de9aff2-a623-4443-9bc7-d05574815e0d" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-quobyte-1de9aff2-a623-4443-9bc7-d05574815e0d" acquired by "delete_volume" :: waited 0.039s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d869bdd2-7212-4312-b117-5f93a2a71901]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1de9aff2-a623-4443-9bc7-d05574815e0d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:36:07 devstack sudo[110805]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Flow 'volume_create_manager' (b405eb36-688d-45c7-8ce9-45a7bbddb80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f61eb5-9374-45cb-b68c-2ef1dacd48f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b" returned: 0 in 0.796s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.067s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-159967169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632548d9-0212-4ace-b4b9-d45526f519ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf42b3ca24d4cc3bb0a823075ed8b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:59Z,use_quota=True,user_id='a7492f92532f4d2da6a0d58fbddcd830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Creating volume 632548d9-0212-4ace-b4b9-d45526f519ce {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:07 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-632548d9-0212-4ace-b4b9-d45526f519ce 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f61eb5-9374-45cb-b68c-2ef1dacd48f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1895116874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad5a9936-d35a-447e-bdad-7339e9f899fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af3e42ba3bc4029a4c66a1d13850205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:08Z,use_quota=True,user_id='cd9f7ad12e0340b7bb024288e4653e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3cc055d-0cad-4981-91d7-82c502b0f856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3cc055d-0cad-4981-91d7-82c502b0f856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:07 devstack sudo[110810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-632548d9-0212-4ace-b4b9-d45526f519ce 1073741824 Jun 15 07:36:07 devstack sudo[110810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74953c95-e203-4562-b9b2-0de2e60523b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:07 devstack sudo[110809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1de9aff2-a623-4443-9bc7-d05574815e0d Jun 15 07:36:07 devstack sudo[110809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74953c95-e203-4562-b9b2-0de2e60523b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad5a9936-d35a-447e-bdad-7339e9f899fe', 'volume_name': 'volume-ad5a9936-d35a-447e-bdad-7339e9f899fe', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93675f07-3a11-406f-a5a2-9af24187c7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93675f07-3a11-406f-a5a2-9af24187c7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d255435-fe31-4095-9c87-37b6d4b726be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:07 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume ad5a9936-d35a-447e-bdad-7339e9f899fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad5a9936-d35a-447e-bdad-7339e9f899fe', 'volume_size': 1} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:07 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Attempting download of 84b8738f-12ad-4797-992f-aa42f77e296d ((None, [{'url': 'file:///opt/stack/data/glance/images/84b8738f-12ad-4797-992f-aa42f77e296d', 'metadata': {}}])) to volume f4ce47ea-fce5-48ab-81d1-afc00ac0105b. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecedb1a-bbe9-43c1-a570-cc24abd20da9]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84b8738f-12ad-4797-992f-aa42f77e296d_bhjpzheb {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Flow 'volume_create_manager' (de5ff379-688e-4644-a803-502d3b8a86b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1da4dfb-f621-42b1-be3f-03f74b706162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:08 devstack sudo[110813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84b8738f-12ad-4797-992f-aa42f77e296d_bhjpzheb Jun 15 07:36:08 devstack sudo[110813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1da4dfb-f621-42b1-be3f-03f74b706162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-977618049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3a0f6b-1d94-4002-847d-bfc7541406f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af3e42ba3bc4029a4c66a1d13850205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:08Z,use_quota=True,user_id='cd9f7ad12e0340b7bb024288e4653e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c99dee-9401-4aad-b777-a5a8b7ddff1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c99dee-9401-4aad-b777-a5a8b7ddff1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a4a300-ce0e-4958-9524-d889ba1fdd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a4a300-ce0e-4958-9524-d889ba1fdd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e3a0f6b-1d94-4002-847d-bfc7541406f3', 'volume_name': 'volume-2e3a0f6b-1d94-4002-847d-bfc7541406f3', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec951daf-efc5-4900-8b20-1c75d5cee393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec951daf-efc5-4900-8b20-1c75d5cee393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf57f5a-ac25-43d1-9adc-e4a3481475ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:08 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume 2e3a0f6b-1d94-4002-847d-bfc7541406f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e3a0f6b-1d94-4002-847d-bfc7541406f3', 'volume_size': 1} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Flow 'volume_create_manager' (ea3ae1ad-3f9a-4c0e-895c-46c062a9fd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999ec3ec-c907-43ab-94a2-aca194265b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999ec3ec-c907-43ab-94a2-aca194265b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-158193854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af3e42ba3bc4029a4c66a1d13850205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:09Z,use_quota=True,user_id='cd9f7ad12e0340b7bb024288e4653e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ec4ffe-2aca-403d-bc19-52838f85e9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ec4ffe-2aca-403d-bc19-52838f85e9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f44872-5d90-4506-9a97-bbfcfe3817b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f44872-5d90-4506-9a97-bbfcfe3817b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80', 'volume_name': 'volume-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e7734e-1140-4ad0-b633-3e34c39b96ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e7734e-1140-4ad0-b633-3e34c39b96ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aabdd845-525c-42e4-99b0-2ca256efba84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:08 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume 67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80', 'volume_size': 1} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:08 devstack sudo[110809]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1de9aff2-a623-4443-9bc7-d05574815e0d" returned: 0 in 1.222s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1de9aff2-a623-4443-9bc7-d05574815e0d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:09 devstack sudo[110823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1de9aff2-a623-4443-9bc7-d05574815e0d Jun 15 07:36:09 devstack sudo[110823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Flow 'volume_create_manager' (4240e195-d86d-4c78-9b8d-d6d1ef61d0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f5c473-01ac-404a-9d2e-cb1b16b0dbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:09 devstack sudo[110813]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f5c473-01ac-404a-9d2e-cb1b16b0dbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-895412851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1077d254-a494-420f-a75d-e39cf1bb0f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af3e42ba3bc4029a4c66a1d13850205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:09Z,use_quota=True,user_id='cd9f7ad12e0340b7bb024288e4653e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71ced84-8a96-47bd-b86e-afe1a223c44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71ced84-8a96-47bd-b86e-afe1a223c44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab00a5e-84dc-4bd7-b28f-ec44ecdc6495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab00a5e-84dc-4bd7-b28f-ec44ecdc6495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1077d254-a494-420f-a75d-e39cf1bb0f62', 'volume_name': 'volume-1077d254-a494-420f-a75d-e39cf1bb0f62', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1d98e4-a2fd-4f34-8453-adb4f3aea8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1d98e4-a2fd-4f34-8453-adb4f3aea8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48259f3a-964f-4a5e-b916-f044d91fff4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:09 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume 1077d254-a494-420f-a75d-e39cf1bb0f62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1077d254-a494-420f-a75d-e39cf1bb0f62', 'volume_size': 1} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84b8738f-12ad-4797-992f-aa42f77e296d_bhjpzheb" returned: 0 in 1.071s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84b8738f-12ad-4797-992f-aa42f77e296d_bhjpzheb {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:09 devstack sudo[110810]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-632548d9-0212-4ace-b4b9-d45526f519ce 1073741824" returned: 0 in 1.285s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-632548d9-0212-4ace-b4b9-d45526f519ce {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:09 devstack sudo[110827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-632548d9-0212-4ace-b4b9-d45526f519ce Jun 15 07:36:09 devstack sudo[110827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:09 devstack sudo[110826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84b8738f-12ad-4797-992f-aa42f77e296d_bhjpzheb Jun 15 07:36:09 devstack sudo[110826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:09 devstack sudo[110823]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1de9aff2-a623-4443-9bc7-d05574815e0d" returned: 0 in 0.655s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-quobyte-1de9aff2-a623-4443-9bc7-d05574815e0d" released by "delete_volume" :: held 1.956s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] Created reservations ['f21287c4-2992-40db-95d9-2d8e4481d1ed', '1f4f4f0b-dbe6-4d87-88dc-28290f0c6198', '37a41233-cbca-4fd1-9d60-6af99f42bd8d', '9f00d59a-e2c1-491c-881d-37de06ad70c3'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:09 devstack sudo[110833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:09 devstack sudo[110833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:09 devstack sudo[110827]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-632548d9-0212-4ace-b4b9-d45526f519ce" returned: 0 in 0.675s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.729s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1876221639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf42b3ca24d4cc3bb0a823075ed8b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:59Z,use_quota=True,user_id='a7492f92532f4d2da6a0d58fbddcd830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Creating volume 57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:09 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:09 devstack sudo[110826]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109e0a05-c489-47ce-baf9-8ea9f2d806ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-632548d9-0212-4ace-b4b9-d45526f519ce', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:09 devstack sudo[110836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c 1073741824 Jun 15 07:36:09 devstack sudo[110836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3369b22c-cb50-49f0-9746-effcf288dd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84b8738f-12ad-4797-992f-aa42f77e296d_bhjpzheb" returned: 1 in 0.801s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84b8738f-12ad-4797-992f-aa42f77e296d_bhjpzheb' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6d0bd8-9f1c-4519-a33b-4fb8edc6a0cd]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:09 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume volume-632548d9-0212-4ace-b4b9-d45526f519ce (632548d9-0212-4ace-b4b9-d45526f519ce): created successfully Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3369b22c-cb50-49f0-9746-effcf288dd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:09 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Flow 'volume_create_manager' (2ed2eb4a-37d4-4186-b7c5-d399eb1bdbec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:09 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0e40c28d-7f4a-4866-a932-0ba88b58ce54 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Created volume successfully. Jun 15 07:36:10 devstack sudo[110838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD Jun 15 07:36:10 devstack sudo[110838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:10 devstack sudo[110833]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.652s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:10 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:10 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] Deleted volume successfully. Jun 15 07:36:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a3fe5565-3407-4103-bf4b-9f2b13e0186a tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-1de9aff2-a623-4443-9bc7-d05574815e0d-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:10 devstack sudo[110836]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:10 devstack sudo[110838]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c 1073741824" returned: 0 in 0.800s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD" returned: 0 in 0.760s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:10 devstack sudo[110848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c Jun 15 07:36:10 devstack sudo[110848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "cinder-b4470042-4cfa-4b17-ae5b-9dc8011d7f21-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:10 devstack sudo[110847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD Jun 15 07:36:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-b4470042-4cfa-4b17-ae5b-9dc8011d7f21-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:10 devstack sudo[110847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "cinder-quobyte-b4470042-4cfa-4b17-ae5b-9dc8011d7f21" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:10 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-quobyte-b4470042-4cfa-4b17-ae5b-9dc8011d7f21" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:10 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb77252-c2c0-4fcd-a2a3-64dc1b489381]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b4470042-4cfa-4b17-ae5b-9dc8011d7f21 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:11 devstack sudo[110851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b4470042-4cfa-4b17-ae5b-9dc8011d7f21 Jun 15 07:36:11 devstack sudo[110851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:11 devstack sudo[110848]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c" returned: 0 in 0.629s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.884s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1914292504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a026ee78-87cf-4881-adf5-e667b89da9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf42b3ca24d4cc3bb0a823075ed8b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:59Z,use_quota=True,user_id='a7492f92532f4d2da6a0d58fbddcd830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Creating volume a026ee78-87cf-4881-adf5-e667b89da9b3 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:11 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a026ee78-87cf-4881-adf5-e667b89da9b3 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d7e30a-9d10-4da3-b588-e3c19691fc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c35b3b-d1bb-4f5f-855f-b142b6753aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:11 devstack sudo[110857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a026ee78-87cf-4881-adf5-e667b89da9b3 1073741824 Jun 15 07:36:11 devstack sudo[110857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:11 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume volume-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c (57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c): created successfully Jun 15 07:36:11 devstack sudo[110847]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c35b3b-d1bb-4f5f-855f-b142b6753aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Flow 'volume_create_manager' (4eed78f0-fa73-4b11-8046-d6477e82c32a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD" returned: 1 in 0.743s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] 84b8738f-12ad-4797-992f-aa42f77e296d was raw, converting to raw {{(pid=92129) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:11 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-723dc79f-8b64-4e27-a662-730f6f320382 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Created volume successfully. Jun 15 07:36:11 devstack sudo[110859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b Jun 15 07:36:11 devstack sudo[110859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:11 devstack sudo[110851]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b4470042-4cfa-4b17-ae5b-9dc8011d7f21" returned: 0 in 0.763s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b4470042-4cfa-4b17-ae5b-9dc8011d7f21 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:11 devstack sudo[110864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b4470042-4cfa-4b17-ae5b-9dc8011d7f21 Jun 15 07:36:11 devstack sudo[110864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:12 devstack sudo[110859]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b" returned: 0 in 0.773s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_84b8738f-12ad-4797-992f-aa42f77e296d_0w0v1fy6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:36:12 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Converted 0.00 MB image at 0.00 MB/s Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:12 devstack sudo[110857]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a026ee78-87cf-4881-adf5-e667b89da9b3 1073741824" returned: 0 in 0.854s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:12 devstack sudo[110873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b 1G Jun 15 07:36:12 devstack sudo[110873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a026ee78-87cf-4881-adf5-e667b89da9b3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:12 devstack sudo[110875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a026ee78-87cf-4881-adf5-e667b89da9b3 Jun 15 07:36:12 devstack sudo[110875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:12 devstack sudo[110864]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-b4470042-4cfa-4b17-ae5b-9dc8011d7f21" returned: 0 in 0.633s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-quobyte-b4470042-4cfa-4b17-ae5b-9dc8011d7f21" released by "delete_volume" :: held 1.455s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] Created reservations ['c71f87aa-97e7-40d5-9fbc-fc7576554edc', 'e2aa189f-aec0-4a48-8148-b831a66b66d8', 'e8a77c94-cd50-461c-adf2-8ce8ea1deaa6', '85a75d08-eee2-446c-bd6e-7ab6736a04ac'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:12 devstack sudo[110877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:12 devstack sudo[110877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:12 devstack sudo[110875]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:12 devstack sudo[110873]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a026ee78-87cf-4881-adf5-e667b89da9b3" returned: 0 in 0.612s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.072s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-165317515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5faf0808-a2e3-4bb3-8284-d648117b35f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf42b3ca24d4cc3bb0a823075ed8b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:00Z,use_quota=True,user_id='a7492f92532f4d2da6a0d58fbddcd830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Creating volume 5faf0808-a2e3-4bb3-8284-d648117b35f0 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:12 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5faf0808-a2e3-4bb3-8284-d648117b35f0 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b 1G" returned: 0 in 0.701s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:12 devstack sudo[110883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5faf0808-a2e3-4bb3-8284-d648117b35f0 1073741824 Jun 15 07:36:12 devstack sudo[110883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27c1028-2510-46a2-9a1a-6f1553054b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a026ee78-87cf-4881-adf5-e667b89da9b3', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a130c0-622b-45d5-85c3-477bbb3e8341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:12 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume volume-a026ee78-87cf-4881-adf5-e667b89da9b3 (a026ee78-87cf-4881-adf5-e667b89da9b3): created successfully Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a130c0-622b-45d5-85c3-477bbb3e8341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:12 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Flow 'volume_create_manager' (edd7d9b1-72bc-4cd9-8df7-70d63063a06f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[579f81d7-e271-4adb-a930-b0be85d57377]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:13 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-bc4975ef-2840-4393-97e3-0bc9c1e9cbc8 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Created volume successfully. Jun 15 07:36:13 devstack sudo[110877]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.608s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:13 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] Deleted volume successfully. Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c8053f9f-cb89-4b99-aa1a-5015e8bb2a23 tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-b4470042-4cfa-4b17-ae5b-9dc8011d7f21-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "cinder-c6401f26-9c72-4f46-a4b7-872662c3b582-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-c6401f26-9c72-4f46-a4b7-872662c3b582-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "cinder-quobyte-c6401f26-9c72-4f46-a4b7-872662c3b582" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-quobyte-c6401f26-9c72-4f46-a4b7-872662c3b582" acquired by "delete_volume" :: waited 0.015s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:13 devstack sudo[110886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b Jun 15 07:36:13 devstack sudo[110886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37380bd-5ac8-4d2f-a516-2ade96b01814]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6401f26-9c72-4f46-a4b7-872662c3b582 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:13 devstack sudo[110888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6401f26-9c72-4f46-a4b7-872662c3b582 Jun 15 07:36:13 devstack sudo[110888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:13 devstack sudo[110883]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5faf0808-a2e3-4bb3-8284-d648117b35f0 1073741824" returned: 0 in 0.886s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5faf0808-a2e3-4bb3-8284-d648117b35f0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:13 devstack sudo[110886]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b" returned: 0 in 0.849s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:13 devstack sudo[110895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5faf0808-a2e3-4bb3-8284-d648117b35f0 Jun 15 07:36:13 devstack sudo[110895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:13 devstack sudo[110897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b Jun 15 07:36:13 devstack sudo[110897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:13 devstack sudo[110902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:13 devstack sudo[110902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:14 devstack sudo[110888]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6401f26-9c72-4f46-a4b7-872662c3b582" returned: 0 in 0.791s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6401f26-9c72-4f46-a4b7-872662c3b582 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:14 devstack sudo[110904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6401f26-9c72-4f46-a4b7-872662c3b582 Jun 15 07:36:14 devstack sudo[110904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:14 devstack sudo[110895]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5faf0808-a2e3-4bb3-8284-d648117b35f0" returned: 0 in 0.700s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.375s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2116988689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f1f9cb1-751a-4b1c-9bf3-581133823ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf42b3ca24d4cc3bb0a823075ed8b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:00Z,use_quota=True,user_id='a7492f92532f4d2da6a0d58fbddcd830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Creating volume 1f1f9cb1-751a-4b1c-9bf3-581133823ab0 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:14 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1f1f9cb1-751a-4b1c-9bf3-581133823ab0 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65533bdb-c8a1-4648-a729-59e218b94b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5faf0808-a2e3-4bb3-8284-d648117b35f0', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:14 devstack sudo[110910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1f1f9cb1-751a-4b1c-9bf3-581133823ab0 1073741824 Jun 15 07:36:14 devstack sudo[110910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7629835-bd40-4817-a138-df2b2e0be0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:14 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume volume-5faf0808-a2e3-4bb3-8284-d648117b35f0 (5faf0808-a2e3-4bb3-8284-d648117b35f0): created successfully Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7629835-bd40-4817-a138-df2b2e0be0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Flow 'volume_create_manager' (5f8e9be6-3f72-45a4-b78a-4288880071d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:14 devstack sudo[110897]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b" returned: 1 in 0.778s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Downloaded image 84b8738f-12ad-4797-992f-aa42f77e296d ((None, [{'url': 'file:///opt/stack/data/glance/images/84b8738f-12ad-4797-992f-aa42f77e296d', 'metadata': {}}])) to volume f4ce47ea-fce5-48ab-81d1-afc00ac0105b successfully. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Temporary image 84b8738f-12ad-4797-992f-aa42f77e296d for user 95e274bd33ce4bd98848c1039ea9c409 is deleted. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Marking volume f4ce47ea-fce5-48ab-81d1-afc00ac0105b as bootable. {{(pid=92129) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:36:14 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-66c8f572-cab7-4e7a-9a57-f15d5a7b717a tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Created volume successfully. Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Copying metadata from image 84b8738f-12ad-4797-992f-aa42f77e296d to f4ce47ea-fce5-48ab-81d1-afc00ac0105b. {{(pid=92129) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Creating volume glance metadata for volume f4ce47ea-fce5-48ab-81d1-afc00ac0105b backed by image 84b8738f-12ad-4797-992f-aa42f77e296d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '84b8738f-12ad-4797-992f-aa42f77e296d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9e32b6751f7f71273d64b11eca57d7ea', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92129) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15af4458-a17b-4467-8392-a1b6768dc06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b', 'volume_size': 1, 'image_id': '84b8738f-12ad-4797-992f-aa42f77e296d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84b8738f-12ad-4797-992f-aa42f77e296d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9e32b6751f7f71273d64b11eca57d7ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3afc07d2f55a48f6909cdcbcdbbe930d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4d8ffc9317254b64c99c93aa7aaefe7c71f171c48fd06e8382f84fd01e774d6642b30f6e4124ae36c0b90b2841c88e4225184f63262902c84522b2d148ab85c5', 'id': '84b8738f-12ad-4797-992f-aa42f77e296d', 'created_at': datetime.datetime(2026, 6, 15, 5, 35, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 35, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8738f-12ad-4797-992f-aa42f77e296d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aabf880e-6735-4903-b285-670fd59764d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:14 devstack sudo[110902]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.767s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 28 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:36:14 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Volume volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b (f4ce47ea-fce5-48ab-81d1-afc00ac0105b): created successfully Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aabf880e-6735-4903-b285-670fd59764d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Flow 'volume_create_manager' (0b311a36-56e0-4fbd-8c02-04d8cbc157d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:14 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-aee9099f-84d0-4036-a9a9-07672948b030 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Created volume successfully. Jun 15 07:36:14 devstack sudo[110904]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-c6401f26-9c72-4f46-a4b7-872662c3b582" returned: 0 in 0.780s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-quobyte-c6401f26-9c72-4f46-a4b7-872662c3b582" released by "delete_volume" :: held 1.631s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] Created reservations ['9aa47c70-e439-410d-8930-f0d984bce5ae', '85e73c4e-ec65-4988-8c73-fb9d21a956eb', '8a246a27-398d-43b5-ba02-458e086e0dd0', '9e87c4c0-49e8-4cd9-9f3e-7c6aaa462045'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:14 devstack sudo[110914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:14 devstack sudo[110914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:15 devstack sudo[110910]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1f1f9cb1-751a-4b1c-9bf3-581133823ab0 1073741824" returned: 0 in 0.875s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Acquiring lock "cinder-f4ce47ea-fce5-48ab-81d1-afc00ac0105b-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1f1f9cb1-751a-4b1c-9bf3-581133823ab0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Lock "cinder-f4ce47ea-fce5-48ab-81d1-afc00ac0105b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:15 devstack sudo[110921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1f1f9cb1-751a-4b1c-9bf3-581133823ab0 Jun 15 07:36:15 devstack sudo[110921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Acquiring lock "cinder-quobyte-f4ce47ea-fce5-48ab-81d1-afc00ac0105b" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:15 devstack sudo[110914]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Lock "cinder-quobyte-f4ce47ea-fce5-48ab-81d1-afc00ac0105b" acquired by "delete_volume" :: waited 0.031s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.697s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:15 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:15 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] Deleted volume successfully. Jun 15 07:36:15 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-74601c43-c15a-4fd5-bf95-e47bc6ceca4c tempest-CreateVolumesFromImageTest-1271911322 None] Lock "cinder-c6401f26-9c72-4f46-a4b7-872662c3b582-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:15 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[020e5c17-0038-4c99-ad54-334f2f92800a]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:15 devstack sudo[110923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b Jun 15 07:36:15 devstack sudo[110923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:16 devstack sudo[110921]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1f1f9cb1-751a-4b1c-9bf3-581133823ab0" returned: 0 in 0.647s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.499s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1492345648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f11ef2-b170-4a4a-a43b-c3c8bb2ff238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af3e42ba3bc4029a4c66a1d13850205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:07Z,use_quota=True,user_id='cd9f7ad12e0340b7bb024288e4653e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Creating volume 46f11ef2-b170-4a4a-a43b-c3c8bb2ff238 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:16 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b9c101-3087-4a59-bae7-f43db64bb710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f1f9cb1-751a-4b1c-9bf3-581133823ab0', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:16 devstack sudo[110926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238 1073741824 Jun 15 07:36:16 devstack sudo[110926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20c6dc9-4613-40c3-af91-e09113b8c87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:16 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Volume volume-1f1f9cb1-751a-4b1c-9bf3-581133823ab0 (1f1f9cb1-751a-4b1c-9bf3-581133823ab0): created successfully Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20c6dc9-4613-40c3-af91-e09113b8c87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Flow 'volume_create_manager' (6f0109cd-87c3-4d76-89ae-522f780bf4d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:16 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c210d3aa-4e06-4d6a-a18c-d725e58fb594 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Created volume successfully. Jun 15 07:36:16 devstack sudo[110923]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b" returned: 0 in 0.754s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:16 devstack sudo[110930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b Jun 15 07:36:16 devstack sudo[110930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "cinder-1f1f9cb1-751a-4b1c-9bf3-581133823ab0-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-1f1f9cb1-751a-4b1c-9bf3-581133823ab0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "cinder-quobyte-1f1f9cb1-751a-4b1c-9bf3-581133823ab0" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-quobyte-1f1f9cb1-751a-4b1c-9bf3-581133823ab0" acquired by "delete_volume" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30efe52-a0ef-4577-bf06-001938008e48]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1f1f9cb1-751a-4b1c-9bf3-581133823ab0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:17 devstack sudo[110936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1f1f9cb1-751a-4b1c-9bf3-581133823ab0 Jun 15 07:36:17 devstack sudo[110936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:17 devstack sudo[110926]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238 1073741824" returned: 0 in 0.995s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:17 devstack sudo[110941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238 Jun 15 07:36:17 devstack sudo[110941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:17 devstack sudo[110930]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b" returned: 1 in 0.894s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:17 devstack sudo[110943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b Jun 15 07:36:17 devstack sudo[110943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:17 devstack sudo[110936]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1f1f9cb1-751a-4b1c-9bf3-581133823ab0" returned: 0 in 0.843s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1f1f9cb1-751a-4b1c-9bf3-581133823ab0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:17 devstack sudo[110949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1f1f9cb1-751a-4b1c-9bf3-581133823ab0 Jun 15 07:36:17 devstack sudo[110949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:17 devstack sudo[110941]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238" returned: 0 in 0.703s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.972s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1895116874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad5a9936-d35a-447e-bdad-7339e9f899fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af3e42ba3bc4029a4c66a1d13850205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:08Z,use_quota=True,user_id='cd9f7ad12e0340b7bb024288e4653e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Creating volume ad5a9936-d35a-447e-bdad-7339e9f899fe {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:17 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ad5a9936-d35a-447e-bdad-7339e9f899fe 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:17 devstack sudo[110952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ad5a9936-d35a-447e-bdad-7339e9f899fe 1073741824 Jun 15 07:36:17 devstack sudo[110952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db95005f-77ec-403f-8eb5-f90d21c03cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:17 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bff3494-d735-40ac-bd7f-c5520c9daa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:18 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume volume-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238 (46f11ef2-b170-4a4a-a43b-c3c8bb2ff238): created successfully Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bff3494-d735-40ac-bd7f-c5520c9daa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Flow 'volume_create_manager' (37aa9001-181d-4da0-8ae5-6422796f8c1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:18 devstack sudo[110943]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-f4ce47ea-fce5-48ab-81d1-afc00ac0105b" returned: 0 in 0.697s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:18 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-a975b4b5-f3ac-40f9-a495-2b9f14e6b8de tempest-CreateVolumesFromSnapshotTest-1857492679 None] Created volume successfully. Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Lock "cinder-quobyte-f4ce47ea-fce5-48ab-81d1-afc00ac0105b" released by "delete_volume" :: held 2.453s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Created reservations ['ea860b82-9b9c-471c-94e3-85c7232c9304', '8eeff7cd-91c5-4f14-9a69-3be943ee4b4e', 'b7e54c43-5dd2-41a3-91cc-e3680b11a2f8', 'bca8ec31-ef9e-4343-a8b1-91af97fde120'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:18 devstack sudo[110954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:18 devstack sudo[110954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:18 devstack sudo[110949]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1f1f9cb1-751a-4b1c-9bf3-581133823ab0" returned: 0 in 0.728s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-quobyte-1f1f9cb1-751a-4b1c-9bf3-581133823ab0" released by "delete_volume" :: held 1.622s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Created reservations ['43d08268-0005-4c9a-810e-1ea37955c1b1', '1a48cd9b-f1a7-4a07-90ef-f208e8bd81bc', '911c59da-436c-4ee6-bb14-3ca459183199', '13925b77-faa8-4e63-8b07-89d6487b883d'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:18 devstack sudo[110960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:18 devstack sudo[110960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:36:19 devstack sudo[110952]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Flow 'volume_create_manager' (6ae13b3f-da46-453e-9afe-15a3d9f9067f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c5fca7-5d56-4148-a759-d4d43d4928db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ad5a9936-d35a-447e-bdad-7339e9f899fe 1073741824" returned: 0 in 1.168s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c5fca7-5d56-4148-a759-d4d43d4928db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1987114607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76769a89-be60-4021-844c-234e8f2518c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9147c523d0a64da78dda28a2526d5cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:19Z,use_quota=True,user_id='b793ebe6a5d94c4da6c0f9c16f286c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2934db2c-3fa8-41c7-8137-210aff1eaf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:19 devstack sudo[110954]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2934db2c-3fa8-41c7-8137-210aff1eaf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74141ff6-5cc6-4309-b4e6-739352cde815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74141ff6-5cc6-4309-b4e6-739352cde815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76769a89-be60-4021-844c-234e8f2518c6', 'volume_name': 'volume-76769a89-be60-4021-844c-234e8f2518c6', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977d3d4b-0361-489b-8cc3-4c860c4121c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977d3d4b-0361-489b-8cc3-4c860c4121c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4726a68-5914-4f64-a298-5dc9ae314e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:19 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Volume 76769a89-be60-4021-844c-234e8f2518c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76769a89-be60-4021-844c-234e8f2518c6', 'volume_size': 1} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "cinder-5faf0808-a2e3-4bb3-8284-d648117b35f0-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.921s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:19 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Deleted volume successfully. Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-5faf0808-a2e3-4bb3-8284-d648117b35f0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ad5a9936-d35a-447e-bdad-7339e9f899fe {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-62dd7d64-481b-45da-abf4-b1141d625812 tempest-VolumeAndVolumeTypeFromImageTest-1788586489 None] Lock "cinder-f4ce47ea-fce5-48ab-81d1-afc00ac0105b-delete_volume" released by "delete_volume" :: held 3.727s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:19 devstack sudo[110964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ad5a9936-d35a-447e-bdad-7339e9f899fe Jun 15 07:36:19 devstack sudo[110964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "cinder-quobyte-5faf0808-a2e3-4bb3-8284-d648117b35f0" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-quobyte-5faf0808-a2e3-4bb3-8284-d648117b35f0" acquired by "delete_volume" :: waited 0.030s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ca1498-aba7-438f-bb58-94c174b0d337]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5faf0808-a2e3-4bb3-8284-d648117b35f0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:19 devstack sudo[110966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5faf0808-a2e3-4bb3-8284-d648117b35f0 Jun 15 07:36:19 devstack sudo[110966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:19 devstack sudo[110960]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.850s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:19 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Deleted volume successfully. Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7a9ed2f0-237f-43e1-912b-db27b6166cbb tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-1f1f9cb1-751a-4b1c-9bf3-581133823ab0-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:19 devstack sudo[110964]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ad5a9936-d35a-447e-bdad-7339e9f899fe" returned: 0 in 0.705s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.532s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-977618049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3a0f6b-1d94-4002-847d-bfc7541406f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af3e42ba3bc4029a4c66a1d13850205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:08Z,use_quota=True,user_id='cd9f7ad12e0340b7bb024288e4653e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Creating volume 2e3a0f6b-1d94-4002-847d-bfc7541406f3 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:19 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:36:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2e3a0f6b-1d94-4002-847d-bfc7541406f3 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:19 devstack sudo[110970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2e3a0f6b-1d94-4002-847d-bfc7541406f3 1073741824 Jun 15 07:36:19 devstack sudo[110970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:20 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d255435-fe31-4095-9c87-37b6d4b726be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad5a9936-d35a-447e-bdad-7339e9f899fe', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:20 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10b64c2-7758-44bf-907d-6e49a5a5ec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:20 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume volume-ad5a9936-d35a-447e-bdad-7339e9f899fe (ad5a9936-d35a-447e-bdad-7339e9f899fe): created successfully Jun 15 07:36:20 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10b64c2-7758-44bf-907d-6e49a5a5ec4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:20 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Flow 'volume_create_manager' (b405eb36-688d-45c7-8ce9-45a7bbddb80a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:20 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f807e97f-0461-4666-8e1f-ccabfc7e8e45 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Created volume successfully. Jun 15 07:36:20 devstack sudo[110966]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5faf0808-a2e3-4bb3-8284-d648117b35f0" returned: 0 in 0.862s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5faf0808-a2e3-4bb3-8284-d648117b35f0 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:20 devstack sudo[110976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5faf0808-a2e3-4bb3-8284-d648117b35f0 Jun 15 07:36:20 devstack sudo[110976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:20 devstack sudo[110970]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2e3a0f6b-1d94-4002-847d-bfc7541406f3 1073741824" returned: 0 in 0.900s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2e3a0f6b-1d94-4002-847d-bfc7541406f3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:20 devstack sudo[110982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2e3a0f6b-1d94-4002-847d-bfc7541406f3 Jun 15 07:36:20 devstack sudo[110982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:20 devstack sudo[110976]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-5faf0808-a2e3-4bb3-8284-d648117b35f0" returned: 0 in 0.708s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:20 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-quobyte-5faf0808-a2e3-4bb3-8284-d648117b35f0" released by "delete_volume" :: held 1.624s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Created reservations ['32ac7905-8d55-47be-8086-fc5a18d3343f', 'e8f09bc7-fc4c-4298-85f4-9f533a762259', '50ec6c93-1134-411c-a3f6-ca93cd53ba27', 'a4fb34d4-8756-40c1-8021-793ea31d9026'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:21 devstack sudo[110984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:21 devstack sudo[110984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "cinder-a026ee78-87cf-4881-adf5-e667b89da9b3-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-a026ee78-87cf-4881-adf5-e667b89da9b3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "cinder-quobyte-a026ee78-87cf-4881-adf5-e667b89da9b3" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-quobyte-a026ee78-87cf-4881-adf5-e667b89da9b3" acquired by "delete_volume" :: waited 0.033s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3d4b09-2152-4d0f-8586-e23b380aeb65]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a026ee78-87cf-4881-adf5-e667b89da9b3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:21 devstack sudo[110982]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2e3a0f6b-1d94-4002-847d-bfc7541406f3" returned: 0 in 0.708s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.891s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-158193854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af3e42ba3bc4029a4c66a1d13850205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:09Z,use_quota=True,user_id='cd9f7ad12e0340b7bb024288e4653e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Creating volume 67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:21 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf57f5a-ac25-43d1-9adc-e4a3481475ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e3a0f6b-1d94-4002-847d-bfc7541406f3', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911bfbe2-f785-466a-b73a-bec2185f82c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:21 devstack sudo[110988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80 1073741824 Jun 15 07:36:21 devstack sudo[110988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:21 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume volume-2e3a0f6b-1d94-4002-847d-bfc7541406f3 (2e3a0f6b-1d94-4002-847d-bfc7541406f3): created successfully Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911bfbe2-f785-466a-b73a-bec2185f82c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Flow 'volume_create_manager' (de5ff379-688e-4644-a803-502d3b8a86b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:21 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-214bbca7-6677-4dc2-b6a8-5d6d740e88bf tempest-CreateVolumesFromSnapshotTest-1857492679 None] Created volume successfully. Jun 15 07:36:21 devstack sudo[110987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a026ee78-87cf-4881-adf5-e667b89da9b3 Jun 15 07:36:21 devstack sudo[110987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:21 devstack sudo[110984]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.782s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:21 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Deleted volume successfully. Jun 15 07:36:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-2fbe3e68-0540-4136-af85-94c4d0676eea tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-5faf0808-a2e3-4bb3-8284-d648117b35f0-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:22 devstack sudo[110987]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a026ee78-87cf-4881-adf5-e667b89da9b3" returned: 0 in 0.902s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a026ee78-87cf-4881-adf5-e667b89da9b3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:22 devstack sudo[110999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a026ee78-87cf-4881-adf5-e667b89da9b3 Jun 15 07:36:22 devstack sudo[110999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:22 devstack sudo[110988]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80 1073741824" returned: 0 in 0.968s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:22 devstack sudo[111001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80 Jun 15 07:36:22 devstack sudo[111001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:23 devstack sudo[110999]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-a026ee78-87cf-4881-adf5-e667b89da9b3" returned: 0 in 0.592s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-quobyte-a026ee78-87cf-4881-adf5-e667b89da9b3" released by "delete_volume" :: held 1.545s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Created reservations ['bef0780e-5e6a-4d22-8229-57ad32c09bcf', '308697f7-f4c3-418d-8e71-42f300c9ac2c', 'c1042c64-f574-4c1e-a188-06ebda17cf18', '90556483-6986-4e31-8197-d52fe0944ee8'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:23 devstack sudo[111001]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80" returned: 0 in 0.567s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.070s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-895412851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1077d254-a494-420f-a75d-e39cf1bb0f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af3e42ba3bc4029a4c66a1d13850205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:09Z,use_quota=True,user_id='cd9f7ad12e0340b7bb024288e4653e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Creating volume 1077d254-a494-420f-a75d-e39cf1bb0f62 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:23 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1077d254-a494-420f-a75d-e39cf1bb0f62 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:23 devstack sudo[111005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1077d254-a494-420f-a75d-e39cf1bb0f62 1073741824 Jun 15 07:36:23 devstack sudo[111005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aabdd845-525c-42e4-99b0-2ca256efba84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd75db9-a0bc-4efc-8c8b-90a6fcaeca37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:23 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume volume-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80 (67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80): created successfully Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd75db9-a0bc-4efc-8c8b-90a6fcaeca37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:23 devstack sudo[111007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Flow 'volume_create_manager' (ea3ae1ad-3f9a-4c0e-895c-46c062a9fd0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:23 devstack sudo[111007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:23 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-80ecaa28-d79c-4a10-a4f0-e477679fc802 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Created volume successfully. Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "cinder-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "cinder-quobyte-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-quobyte-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c" acquired by "delete_volume" :: waited 0.020s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad989524-ef24-4366-8688-66a09de63d42]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:23 devstack sudo[111012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c Jun 15 07:36:23 devstack sudo[111012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:23 devstack sudo[111007]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.665s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:23 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:23 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Deleted volume successfully. Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-8bcaa0d3-369d-461f-9102-a339c9990253 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-a026ee78-87cf-4881-adf5-e667b89da9b3-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:24 devstack sudo[111005]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1077d254-a494-420f-a75d-e39cf1bb0f62 1073741824" returned: 0 in 0.865s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1077d254-a494-420f-a75d-e39cf1bb0f62 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:24 devstack sudo[111015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1077d254-a494-420f-a75d-e39cf1bb0f62 Jun 15 07:36:24 devstack sudo[111015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:24 devstack sudo[111012]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c" returned: 0 in 0.775s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:24 devstack sudo[111026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c Jun 15 07:36:24 devstack sudo[111026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:24 devstack sudo[111015]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1077d254-a494-420f-a75d-e39cf1bb0f62" returned: 0 in 0.632s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.578s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1987114607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76769a89-be60-4021-844c-234e8f2518c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9147c523d0a64da78dda28a2526d5cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:19Z,use_quota=True,user_id='b793ebe6a5d94c4da6c0f9c16f286c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Creating volume 76769a89-be60-4021-844c-234e8f2518c6 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:24 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:24 devstack sudo[111029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 1073741824 Jun 15 07:36:24 devstack sudo[111029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48259f3a-964f-4a5e-b916-f044d91fff4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1077d254-a494-420f-a75d-e39cf1bb0f62', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06710f5-27d0-4f4e-888e-2ecf15b6f56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:24 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Volume volume-1077d254-a494-420f-a75d-e39cf1bb0f62 (1077d254-a494-420f-a75d-e39cf1bb0f62): created successfully Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06710f5-27d0-4f4e-888e-2ecf15b6f56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:24 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Flow 'volume_create_manager' (4240e195-d86d-4c78-9b8d-d6d1ef61d0f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:24 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-ffccb94b-f330-42c6-a34c-014fc52b1e6f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Created volume successfully. Jun 15 07:36:25 devstack sudo[111026]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c" returned: 0 in 0.594s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-quobyte-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c" released by "delete_volume" :: held 1.408s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Created reservations ['6af079f8-62a3-433f-98fc-4b321578bb55', '40903a80-155f-45e0-a402-c53daed3495b', 'bbe4f4df-0c53-4a8b-b9d2-a31fa02fdd2a', 'e09d2be8-a48e-4e5c-876d-88a098ad06b3'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:25 devstack sudo[111035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:25 devstack sudo[111035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:25 devstack sudo[111029]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 1073741824" returned: 0 in 0.798s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "cinder-1077d254-a494-420f-a75d-e39cf1bb0f62-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:25 devstack sudo[111038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 Jun 15 07:36:25 devstack sudo[111038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-1077d254-a494-420f-a75d-e39cf1bb0f62-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "cinder-quobyte-1077d254-a494-420f-a75d-e39cf1bb0f62" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-quobyte-1077d254-a494-420f-a75d-e39cf1bb0f62" acquired by "delete_volume" :: waited 0.014s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed0fdea-9db1-49a2-b470-f4ee68be5e7d]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1077d254-a494-420f-a75d-e39cf1bb0f62 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:25 devstack sudo[111040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1077d254-a494-420f-a75d-e39cf1bb0f62 Jun 15 07:36:25 devstack sudo[111040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "cinder-632548d9-0212-4ace-b4b9-d45526f519ce-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:25 devstack sudo[111035]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.678s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:25 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:26 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Deleted volume successfully. Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-632548d9-0212-4ace-b4b9-d45526f519ce-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-667cc566-ef0f-4f14-80c1-4285845cf6db tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-57ae5ebc-a8c4-404c-81a3-759d3c9d0a8c-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "cinder-quobyte-632548d9-0212-4ace-b4b9-d45526f519ce" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-quobyte-632548d9-0212-4ace-b4b9-d45526f519ce" acquired by "delete_volume" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7026b5db-e686-40e7-b735-7e756e7e2829]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-632548d9-0212-4ace-b4b9-d45526f519ce {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:26 devstack sudo[111038]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6" returned: 0 in 0.616s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4726a68-5914-4f64-a298-5dc9ae314e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76769a89-be60-4021-844c-234e8f2518c6', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:26 devstack sudo[111044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-632548d9-0212-4ace-b4b9-d45526f519ce Jun 15 07:36:26 devstack sudo[111044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0f6823-decc-431d-a9e6-1dcb8a3d2781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:26 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Volume volume-76769a89-be60-4021-844c-234e8f2518c6 (76769a89-be60-4021-844c-234e8f2518c6): created successfully Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0f6823-decc-431d-a9e6-1dcb8a3d2781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Flow 'volume_create_manager' (6ae13b3f-da46-453e-9afe-15a3d9f9067f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:26 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-39a36737-e845-4c6a-8b40-4675515ca2f6 tempest-VolumeDependencyTests-340244090 None] Created volume successfully. Jun 15 07:36:26 devstack sudo[111040]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1077d254-a494-420f-a75d-e39cf1bb0f62" returned: 0 in 0.801s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1077d254-a494-420f-a75d-e39cf1bb0f62 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:26 devstack sudo[111049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1077d254-a494-420f-a75d-e39cf1bb0f62 Jun 15 07:36:26 devstack sudo[111049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] Creating offline snapshot b01c2860-3494-4ce9-82c5-301e288c1320 of volume 76769a89-be60-4021-844c-234e8f2518c6 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd04e012-3c5c-42a3-9a2e-0528b8b37955]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:26 devstack sudo[111044]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-632548d9-0212-4ace-b4b9-d45526f519ce" returned: 0 in 0.775s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:26 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-632548d9-0212-4ace-b4b9-d45526f519ce {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:26 devstack sudo[111055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-632548d9-0212-4ace-b4b9-d45526f519ce Jun 15 07:36:26 devstack sudo[111055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:26 devstack sudo[111054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 Jun 15 07:36:26 devstack sudo[111054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:27 devstack sudo[111049]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-1077d254-a494-420f-a75d-e39cf1bb0f62" returned: 0 in 0.628s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-quobyte-1077d254-a494-420f-a75d-e39cf1bb0f62" released by "delete_volume" :: held 1.475s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Created reservations ['364facab-d795-4688-b246-ede04eca352d', '69b92808-9c3c-480d-b9b3-dfe06c96496f', '08f7edeb-5d00-440e-8a9e-50eec3e7ed6a', '93fd692d-472f-41f4-9ce5-0d3dcc6231eb'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:27 devstack sudo[111059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:27 devstack sudo[111059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:27 devstack sudo[111055]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-632548d9-0212-4ace-b4b9-d45526f519ce" returned: 0 in 0.612s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-quobyte-632548d9-0212-4ace-b4b9-d45526f519ce" released by "delete_volume" :: held 1.434s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Created reservations ['d22716e8-a245-4289-a10e-48e6f6aaaf2c', 'ed72ecb1-ab5b-40c1-b259-205cdedd9d46', '786de419-8dc6-4892-8384-e6a6aa01c94c', '1d6f3ed4-e5af-489f-bbf8-62a3acc66127'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:27 devstack sudo[111054]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6" returned: 0 in 0.780s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:27 devstack sudo[111065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:27 devstack sudo[111065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:27 devstack sudo[111066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320 1G Jun 15 07:36:27 devstack sudo[111066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "cinder-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "cinder-quobyte-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:27 devstack sudo[111059]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.680s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:27 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Deleted volume successfully. Jun 15 07:36:27 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-quobyte-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80" acquired by "delete_volume" :: waited 0.020s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a23b0d70-7583-4fd4-8062-af48994846a3 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-1077d254-a494-420f-a75d-e39cf1bb0f62-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:28 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2e7f1d-d082-4361-b4b8-4d04724e01e0]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:28 devstack sudo[111070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80 Jun 15 07:36:28 devstack sudo[111070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "cinder-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "cinder-quobyte-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-quobyte-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3" acquired by "delete_volume" :: waited 0.019s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:28 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbed419-a670-40bc-9f57-b82cc7d9f918]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:28 devstack sudo[111065]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.775s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:28 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:28 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Deleted volume successfully. Jun 15 07:36:28 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f4e34ff0-2a2a-448b-bf9e-16519852c091 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-632548d9-0212-4ace-b4b9-d45526f519ce-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:28 devstack sudo[111076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3 Jun 15 07:36:28 devstack sudo[111076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:28 devstack sudo[111066]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320 1G" returned: 0 in 0.911s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76769a89-be60-4021-844c-234e8f2518c6 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:28 devstack sudo[111079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76769a89-be60-4021-844c-234e8f2518c6 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320 Jun 15 07:36:28 devstack sudo[111079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:28 devstack sudo[111070]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80" returned: 0 in 0.814s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:28 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:28 devstack sudo[111084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80 Jun 15 07:36:28 devstack sudo[111084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:29 devstack sudo[111076]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3" returned: 0 in 0.776s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:29 devstack sudo[111092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3 Jun 15 07:36:29 devstack sudo[111092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:29 devstack sudo[111079]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76769a89-be60-4021-844c-234e8f2518c6 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320" returned: 0 in 0.708s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:29 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320 is being set with open permissions: ugo+rw Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:29 devstack sudo[111094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320 Jun 15 07:36:29 devstack sudo[111094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:29 devstack sudo[111084]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80" returned: 0 in 0.633s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-quobyte-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80" released by "delete_volume" :: held 1.506s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Created reservations ['7f949bf4-0b16-4c66-8315-8e371c937413', 'f6587a6b-f403-440e-b0fe-dc82c8eb45b0', '68b377a2-c925-4c3c-ab0d-af350abfea93', '131d37ff-1ecc-41ed-9f59-669e7c6f54bc'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:29 devstack sudo[111097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:29 devstack sudo[111097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:29 devstack sudo[111092]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3" returned: 0 in 0.656s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-quobyte-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3" released by "delete_volume" :: held 1.477s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Created reservations ['52e28f34-c3cd-4b3e-8237-10bad025a27e', '232bccd9-236f-4661-a897-e63b9182e098', '77861a7f-02fe-4f76-864a-a3ef4ed84cae', '8419b8d9-ec43-48a1-b706-770bc889c990'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:29 devstack sudo[111094]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320" returned: 0 in 0.664s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:29 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:30 devstack sudo[111101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:30 devstack sudo[111101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:30 devstack sudo[111104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.info Jun 15 07:36:30 devstack sudo[111104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:30 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "cinder-2e3a0f6b-1d94-4002-847d-bfc7541406f3-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:30 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-2e3a0f6b-1d94-4002-847d-bfc7541406f3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:30 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "cinder-quobyte-2e3a0f6b-1d94-4002-847d-bfc7541406f3" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:30 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-quobyte-2e3a0f6b-1d94-4002-847d-bfc7541406f3" acquired by "delete_volume" :: waited 0.013s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:30 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffdfed8-66c1-40c4-b884-78dffa627cad]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2e3a0f6b-1d94-4002-847d-bfc7541406f3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:30 devstack sudo[111097]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.680s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:30 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:30 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Deleted volume successfully. Jun 15 07:36:30 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-9378c356-1cf4-4e20-9914-41a7c515c1c5 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-67d3e0c4-31e4-4ed7-91ae-dcb79bd1ea80-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:30 devstack sudo[111107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2e3a0f6b-1d94-4002-847d-bfc7541406f3 Jun 15 07:36:30 devstack sudo[111107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:30 devstack sudo[111101]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.731s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:30 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:30 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Deleted volume successfully. Jun 15 07:36:30 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-60cd38ff-92b4-4f4a-91ac-7e8d4085c8c0 tempest-CreateVolumesFromSourceVolumeTest-1813286490 None] Lock "cinder-62a176bd-f0b8-4f6e-81fe-4fad9989e6f3-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:30 devstack sudo[111104]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.info" returned: 0 in 0.759s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:30 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.info is being set with open permissions: ugo+rw Jun 15 07:36:30 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:30 devstack sudo[111111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.info Jun 15 07:36:30 devstack sudo[111111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:31 devstack sudo[111107]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2e3a0f6b-1d94-4002-847d-bfc7541406f3" returned: 0 in 0.809s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2e3a0f6b-1d94-4002-847d-bfc7541406f3 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:31 devstack sudo[111116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2e3a0f6b-1d94-4002-847d-bfc7541406f3 Jun 15 07:36:31 devstack sudo[111116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:31 devstack sudo[111111]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.info" returned: 0 in 0.662s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.605s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:31 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-0049b187-2e21-4c4d-b24d-f51914ef698f tempest-VolumeDependencyTests-340244090 None] Create snapshot completed successfully Jun 15 07:36:31 devstack sudo[111116]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2e3a0f6b-1d94-4002-847d-bfc7541406f3" returned: 0 in 0.665s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:31 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-quobyte-2e3a0f6b-1d94-4002-847d-bfc7541406f3" released by "delete_volume" :: held 1.525s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:31 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Created reservations ['ccf83d8e-664f-4eed-87aa-da47520b5a2b', '88f6f4ef-0071-42e7-a714-8de8a234c69b', '34fb10d8-e680-4f43-a364-dff27b1f75aa', '160f9ed7-57e6-4c72-93d2-7650ed925690'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:31 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:31 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:31 devstack sudo[111120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:31 devstack sudo[111120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "cinder-ad5a9936-d35a-447e-bdad-7339e9f899fe-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-ad5a9936-d35a-447e-bdad-7339e9f899fe-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "cinder-quobyte-ad5a9936-d35a-447e-bdad-7339e9f899fe" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-quobyte-ad5a9936-d35a-447e-bdad-7339e9f899fe" acquired by "delete_volume" :: waited 0.023s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:32 devstack sudo[111120]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.737s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4253629-0ed6-44ce-9d5a-2487d391f358]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ad5a9936-d35a-447e-bdad-7339e9f899fe {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:32 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Deleted volume successfully. Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Flow 'volume_create_manager' (9da5f5a0-bd39-48dc-b43f-a2074f1d99a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6902344d-9ca0-4dbf-808f-9fecddf93134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6902344d-9ca0-4dbf-808f-9fecddf93134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1899602858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf87ba28-f404-47ec-9d5a-d3c44c133f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9147c523d0a64da78dda28a2526d5cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b01c2860-3494-4ce9-82c5-301e288c1320,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:33Z,use_quota=True,user_id='b793ebe6a5d94c4da6c0f9c16f286c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c06c91-080a-4236-a5d4-56e0710b54da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c06c91-080a-4236-a5d4-56e0710b54da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ce1e59-3a64-42bf-9171-903a73a74170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ce1e59-3a64-42bf-9171-903a73a74170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cf87ba28-f404-47ec-9d5a-d3c44c133f1b', 'volume_name': 'volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b', 'volume_size': 1, 'snapshot_id': 'b01c2860-3494-4ce9-82c5-301e288c1320'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62f042a-d977-4490-9aa5-bcb5d751de23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62f042a-d977-4490-9aa5-bcb5d751de23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39ee9d4-c7c6-44c7-92ca-46a9585f7e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:32 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Volume cf87ba28-f404-47ec-9d5a-d3c44c133f1b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b', 'volume_size': 1, 'snapshot_id': 'b01c2860-3494-4ce9-82c5-301e288c1320'} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-396e2939-1089-43dc-ade5-a5ad131b961f tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-2e3a0f6b-1d94-4002-847d-bfc7541406f3-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Acquiring lock "cinder-quobyte-b01c2860-3494-4ce9-82c5-301e288c1320-cf87ba28-f404-47ec-9d5a-d3c44c133f1b" by "_create_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:32 devstack sudo[111123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ad5a9936-d35a-447e-bdad-7339e9f899fe Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Lock "cinder-quobyte-b01c2860-3494-4ce9-82c5-301e288c1320-cf87ba28-f404-47ec-9d5a-d3c44c133f1b" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Creating volume cf87ba28-f404-47ec-9d5a-d3c44c133f1b from snapshot b01c2860-3494-4ce9-82c5-301e288c1320 {{(pid=92129) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:32 devstack sudo[111123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Acquiring lock "cinder-quobyte-cf87ba28-f404-47ec-9d5a-d3c44c133f1b" by "_copy_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Lock "cinder-quobyte-cf87ba28-f404-47ec-9d5a-d3c44c133f1b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] snapshot: b01c2860-3494-4ce9-82c5-301e288c1320, volume: cf87ba28-f404-47ec-9d5a-d3c44c133f1b, {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a5cb26-cb09-4206-862b-2b4d47726833]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:32 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:32 devstack sudo[111125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320 Jun 15 07:36:32 devstack sudo[111125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:33 devstack sudo[111123]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ad5a9936-d35a-447e-bdad-7339e9f899fe" returned: 0 in 0.776s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ad5a9936-d35a-447e-bdad-7339e9f899fe {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:33 devstack sudo[111130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ad5a9936-d35a-447e-bdad-7339e9f899fe Jun 15 07:36:33 devstack sudo[111130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:33 devstack sudo[111125]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320" returned: 0 in 0.809s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76769a89-be60-4021-844c-234e8f2518c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:36:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:36:33 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Creating direct copy from snapshot {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:36:33 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5e2074-b37d-45c5-8077-8afbe569084e]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:33 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:33 devstack sudo[111136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 Jun 15 07:36:33 devstack sudo[111136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:34 devstack sudo[111130]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-ad5a9936-d35a-447e-bdad-7339e9f899fe" returned: 0 in 0.706s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-quobyte-ad5a9936-d35a-447e-bdad-7339e9f899fe" released by "delete_volume" :: held 1.536s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Created reservations ['eb485a2a-8ade-4c05-a0c8-57c0c87da5cf', '6297b532-b9ff-4836-af82-dfcc37de10a0', '41a1c70e-24f4-4951-bebe-10008ee29234', '6673e487-bc38-463d-b181-0b4ca461c141'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:34 devstack sudo[111139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:34 devstack sudo[111139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:34 devstack sudo[111136]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6" returned: 0 in 0.888s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG cinder.utils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Path /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b not found in is_blk_device check {{(pid=92129) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:34 devstack sudo[111145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b Jun 15 07:36:34 devstack sudo[111145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "cinder-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "cinder-quobyte-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-quobyte-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238" acquired by "delete_volume" :: waited 0.027s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb57f08-4c76-4ea5-b50f-7d4ea9ab7fc2]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:34 devstack sudo[111139]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.722s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:34 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:34 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Deleted volume successfully. Jun 15 07:36:35 devstack sudo[111148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238 Jun 15 07:36:35 devstack sudo[111148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:35 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6dbeb3e4-396d-4425-842f-34f5da7dce5e tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-ad5a9936-d35a-447e-bdad-7339e9f899fe-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:36 devstack sudo[111148]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238" returned: 0 in 1.150s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:36 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:36 devstack sudo[111163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238 Jun 15 07:36:36 devstack sudo[111163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:37 devstack sudo[111163]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238" returned: 0 in 1.465s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:37 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-quobyte-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238" released by "delete_volume" :: held 2.675s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:37 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] Created reservations ['440cb4af-27e2-4688-81ee-63794eee7b77', 'e026ee88-45e0-4e33-a1c3-64cba9d60708', '19ea7e98-c14c-42dc-8aa4-3ff1c4e7e14f', 'b9ca3be4-cdc7-46ee-825c-1d962343e87c'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:37 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:37 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:37 devstack sudo[111167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:37 devstack sudo[111167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "cinder-b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "cinder-quobyte-85288128-3972-411f-a9f0-21ff406d0067" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-quobyte-85288128-3972-411f-a9f0-21ff406d0067" acquired by "delete_snapshot" :: waited 0.046s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "cinder-quobyte-b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:38 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-quobyte-b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Deleting offline snapshot b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a of volume 85288128-3972-411f-a9f0-21ff406d0067 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:36:38 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] snapshot_file for this snap is: volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:36:38 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2320b8e9-8683-449f-835e-fe4c8604e5a5]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:38 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:39 devstack sudo[111169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a Jun 15 07:36:39 devstack sudo[111169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:39 devstack sudo[111167]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:39 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 1.537s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:39 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:39 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] Deleted volume successfully. Jun 15 07:36:39 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e2e72b6e-4731-46cb-a64d-c6afdf1b628a tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-46f11ef2-b170-4a4a-a43b-c3c8bb2ff238-delete_volume" released by "delete_volume" :: held 4.757s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:40 devstack sudo[111169]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a" returned: 0 in 1.689s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:40 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85288128-3972-411f-a9f0-21ff406d0067(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:36:40 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8561f1fe-ae30-4902-8c2f-64a132584550]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:40 devstack sudo[111145]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b" returned: 0 in 5.888s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:40 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cf8e0d-fb2c-48a9-9260-0ff4a364b5a2]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:40 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:40 devstack sudo[111178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067 Jun 15 07:36:40 devstack sudo[111178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:40 devstack sudo[111179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 Jun 15 07:36:40 devstack sudo[111179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:41 devstack sudo[111178]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067" returned: 0 in 0.853s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:41 devstack sudo[111190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a Jun 15 07:36:41 devstack sudo[111190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:41 devstack sudo[111179]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6" returned: 0 in 1.074s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:41 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Image conversion details: src /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:36:41 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Converted 1024.00 MB image at 173.84 MB/s Jun 15 07:36:41 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b is being set with open permissions: ugo+rw Jun 15 07:36:41 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:41 devstack sudo[111195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b Jun 15 07:36:41 devstack sudo[111195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:42 devstack sudo[111190]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a" returned: 0 in 0.757s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:42 devstack sudo[111201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a Jun 15 07:36:42 devstack sudo[111201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:42 devstack sudo[111195]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b" returned: 0 in 0.638s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Lock "cinder-quobyte-cf87ba28-f404-47ec-9d5a-d3c44c133f1b" released by "_copy_volume_from_snapshot" :: held 9.406s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Lock "cinder-quobyte-b01c2860-3494-4ce9-82c5-301e288c1320-cf87ba28-f404-47ec-9d5a-d3c44c133f1b" released by "_create_volume_from_snapshot" :: held 9.439s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.455s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39ee9d4-c7c6-44c7-92ca-46a9585f7e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b', 'volume_size': 1, 'snapshot_id': 'b01c2860-3494-4ce9-82c5-301e288c1320'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705a815b-6965-494a-a113-663f0709c088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:42 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Volume volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b (cf87ba28-f404-47ec-9d5a-d3c44c133f1b): created successfully Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705a815b-6965-494a-a113-663f0709c088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Flow 'volume_create_manager' (9da5f5a0-bd39-48dc-b43f-a2074f1d99a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:42 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c77ddb86-316c-4825-95d5-c5db78445de3 tempest-VolumeDependencyTests-340244090 None] Created volume successfully. Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] Acquiring lock "cinder-b01c2860-3494-4ce9-82c5-301e288c1320-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:42 devstack sudo[111201]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067.b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a" returned: 0 in 0.690s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] Lock "cinder-b01c2860-3494-4ce9-82c5-301e288c1320-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] Acquiring lock "cinder-quobyte-76769a89-be60-4021-844c-234e8f2518c6" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] Lock "cinder-quobyte-76769a89-be60-4021-844c-234e8f2518c6" acquired by "delete_snapshot" :: waited 0.038s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] Acquiring lock "cinder-quobyte-b01c2860-3494-4ce9-82c5-301e288c1320" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-quobyte-b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a" released by "_delete_snapshot" :: held 4.207s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-quobyte-85288128-3972-411f-a9f0-21ff406d0067" released by "delete_snapshot" :: held 4.277s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] Lock "cinder-quobyte-b01c2860-3494-4ce9-82c5-301e288c1320" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] Deleting offline snapshot b01c2860-3494-4ce9-82c5-301e288c1320 of volume 76769a89-be60-4021-844c-234e8f2518c6 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] snapshot_file for this snap is: volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e04a438-7abf-4400-ae38-41570d09f4c1]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Created reservations ['16730a68-f5d8-40cd-ad1f-902f5565405b', 'c264087e-d7da-433f-a9f3-dac784efa98f', 'f6a16f09-f1f3-474a-af75-1eb3c9cc2232', '612230a2-27c5-41f0-bb2a-c5c4ab9f1ea0'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:42 devstack sudo[111205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320 Jun 15 07:36:42 devstack sudo[111205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:42 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Delete snapshot completed successfully. Jun 15 07:36:42 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-3ef4de05-af47-4e7d-aa74-cd4fd0c586b2 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-b7c8c4ee-8d4f-4ab5-8e28-02b010d75e5a-delete_snapshot" released by "delete_snapshot" :: held 4.519s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:43 devstack sudo[111205]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320" returned: 0 in 0.755s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:43 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76769a89-be60-4021-844c-234e8f2518c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:36:43 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[65803e42-9a47-4d34-9322-433598236687]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:43 devstack sudo[111210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 Jun 15 07:36:43 devstack sudo[111210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "cinder-85288128-3972-411f-a9f0-21ff406d0067-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-85288128-3972-411f-a9f0-21ff406d0067-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "cinder-quobyte-85288128-3972-411f-a9f0-21ff406d0067" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:43 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-quobyte-85288128-3972-411f-a9f0-21ff406d0067" acquired by "delete_volume" :: waited 0.020s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:43 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6617bf-b613-4363-a5e1-5ab69927a27e]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:43 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:44 devstack sudo[111212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067 Jun 15 07:36:44 devstack sudo[111212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:44 devstack sudo[111210]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6" returned: 0 in 0.817s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:44 devstack sudo[111217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320 Jun 15 07:36:44 devstack sudo[111217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:44 devstack sudo[111212]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067" returned: 0 in 0.779s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:44 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:44 devstack sudo[111222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067 Jun 15 07:36:44 devstack sudo[111222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:45 devstack sudo[111217]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320" returned: 0 in 0.842s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:45 devstack sudo[111262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320 Jun 15 07:36:45 devstack sudo[111262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:45 devstack sudo[111222]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-85288128-3972-411f-a9f0-21ff406d0067" returned: 0 in 0.781s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:45 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-quobyte-85288128-3972-411f-a9f0-21ff406d0067" released by "delete_volume" :: held 1.640s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:45 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Created reservations ['d4b2e19b-7c7a-4cbc-8e97-78ea1a957a8a', 'dc71df03-767c-4df2-af39-544a6ed57e10', 'ca789c4a-704e-461b-a687-0a50b42d31ba', 'a6f6d549-daaf-4cc5-8197-681bb19c0e61'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:45 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:45 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:45 devstack sudo[111266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:45 devstack sudo[111266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:46 devstack sudo[111262]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6.b01c2860-3494-4ce9-82c5-301e288c1320" returned: 0 in 0.796s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] Lock "cinder-quobyte-b01c2860-3494-4ce9-82c5-301e288c1320" released by "_delete_snapshot" :: held 3.404s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] Lock "cinder-quobyte-76769a89-be60-4021-844c-234e8f2518c6" released by "delete_snapshot" :: held 3.441s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:46 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] Created reservations ['4dead382-0bee-4a12-a5f4-ed81e03d2176', '02678489-6986-4026-85e9-41d07625aaf9', '10af8c10-80cd-4f52-83be-46dd0214170f', '74d83037-e59f-4b69-b7d7-542fd5b9f854'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:46 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] Delete snapshot completed successfully. Jun 15 07:36:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-7d1c033a-563a-4446-b72b-17d3c217019a tempest-VolumeDependencyTests-340244090 None] Lock "cinder-b01c2860-3494-4ce9-82c5-301e288c1320-delete_snapshot" released by "delete_snapshot" :: held 3.675s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:46 devstack sudo[111266]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:46 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.857s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:46 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:46 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Deleted volume successfully. Jun 15 07:36:46 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-1dd6e73c-551a-4da4-befc-82ea31af52d4 tempest-CreateVolumesFromSnapshotTest-1857492679 None] Lock "cinder-85288128-3972-411f-a9f0-21ff406d0067-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] Acquiring lock "cinder-76769a89-be60-4021-844c-234e8f2518c6-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] Lock "cinder-76769a89-be60-4021-844c-234e8f2518c6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] Acquiring lock "cinder-quobyte-76769a89-be60-4021-844c-234e8f2518c6" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:47 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] Lock "cinder-quobyte-76769a89-be60-4021-844c-234e8f2518c6" acquired by "delete_volume" :: waited 0.036s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:47 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3dde79-9470-40e3-9e53-63fa371dafb4]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:47 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:47 devstack sudo[111271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 Jun 15 07:36:47 devstack sudo[111271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:48 devstack sudo[111271]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6" returned: 0 in 0.819s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:48 devstack sudo[111278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6 Jun 15 07:36:48 devstack sudo[111278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:48 devstack sudo[111278]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-76769a89-be60-4021-844c-234e8f2518c6" returned: 0 in 0.776s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:48 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] Lock "cinder-quobyte-76769a89-be60-4021-844c-234e8f2518c6" released by "delete_volume" :: held 1.672s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:48 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] Created reservations ['acc1210d-1f84-42a0-a87a-8e86021696df', 'b88f3e72-7e5c-40d9-814d-5cae8fb40793', '874cb3f5-ac0c-42a8-9cc1-3f5be7eeb834', 'e52d5f40-3a2d-4e25-a404-6e512a07df78'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:48 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:48 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:49 devstack sudo[111281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:49 devstack sudo[111281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] Acquiring lock "cinder-cf87ba28-f404-47ec-9d5a-d3c44c133f1b-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] Lock "cinder-cf87ba28-f404-47ec-9d5a-d3c44c133f1b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] Acquiring lock "cinder-quobyte-cf87ba28-f404-47ec-9d5a-d3c44c133f1b" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] Lock "cinder-quobyte-cf87ba28-f404-47ec-9d5a-d3c44c133f1b" acquired by "delete_volume" :: waited 0.015s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f094030-e1d4-4f54-9022-5503f00ebe38]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Flow 'volume_create_manager' (a2d5310c-d28a-4c88-b18e-1cac50092bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb278eb-0533-4fbd-a438-c16258b39fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb278eb-0533-4fbd-a438-c16258b39fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7c273d-cf30-49c4-a04b-1204eda0cdf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3486475d0f430396667c7fd2410f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:50Z,use_quota=True,user_id='79317cbdb422489c875063f39002e3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c086e0-df05-4161-a5bb-ea265a839a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c086e0-df05-4161-a5bb-ea265a839a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d4ab19-2fdd-40f8-ad92-1d0513050799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d4ab19-2fdd-40f8-ad92-1d0513050799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e7c273d-cf30-49c4-a04b-1204eda0cdf7', 'volume_name': 'volume-7e7c273d-cf30-49c4-a04b-1204eda0cdf7', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892d9551-68e6-4fd4-9c37-db453ac9ff61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892d9551-68e6-4fd4-9c37-db453ac9ff61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5983cf3c-85fc-4cf4-81c6-1f5ea5510c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:49 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Volume 7e7c273d-cf30-49c4-a04b-1204eda0cdf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e7c273d-cf30-49c4-a04b-1204eda0cdf7', 'volume_size': 1} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7c273d-cf30-49c4-a04b-1204eda0cdf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3486475d0f430396667c7fd2410f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:50Z,use_quota=True,user_id='79317cbdb422489c875063f39002e3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Creating volume 7e7c273d-cf30-49c4-a04b-1204eda0cdf7 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:49 devstack sudo[111283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b Jun 15 07:36:49 devstack sudo[111283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:49 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7e7c273d-cf30-49c4-a04b-1204eda0cdf7 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:49 devstack sudo[111281]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.763s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:49 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] Deleted volume successfully. Jun 15 07:36:49 devstack sudo[111286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7e7c273d-cf30-49c4-a04b-1204eda0cdf7 1073741824 Jun 15 07:36:49 devstack sudo[111286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:49 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e4b8abeb-c63a-4bf6-b90c-716de11a2a72 tempest-VolumeDependencyTests-340244090 None] Lock "cinder-76769a89-be60-4021-844c-234e8f2518c6-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:50 devstack sudo[111283]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b" returned: 0 in 0.824s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:50 devstack sudo[111295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b Jun 15 07:36:50 devstack sudo[111295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:50 devstack sudo[111286]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7e7c273d-cf30-49c4-a04b-1204eda0cdf7 1073741824" returned: 0 in 0.876s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:50 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=167,cinder:UPDATE=229,cinder:INSERT=58,cinder:DELETE=26 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:36:50 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7e7c273d-cf30-49c4-a04b-1204eda0cdf7 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:50 devstack sudo[111297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7e7c273d-cf30-49c4-a04b-1204eda0cdf7 Jun 15 07:36:50 devstack sudo[111297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:51 devstack sudo[111295]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-cf87ba28-f404-47ec-9d5a-d3c44c133f1b" returned: 0 in 0.795s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:51 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] Lock "cinder-quobyte-cf87ba28-f404-47ec-9d5a-d3c44c133f1b" released by "delete_volume" :: held 1.671s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:51 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] Created reservations ['76e10e83-dc75-43bb-b7ff-b4288ea2e014', 'b1465707-1a60-42eb-a211-0e27cbd2dae2', 'c5f39ba7-a905-4c3f-9987-cec98d0a2687', 'e5525814-f207-4e99-8d83-d9451b7907b3'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:51 devstack sudo[111297]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:51 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:51 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7e7c273d-cf30-49c4-a04b-1204eda0cdf7" returned: 0 in 0.714s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:51 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:51 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:51 devstack sudo[111301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:36:51 devstack sudo[111301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5983cf3c-85fc-4cf4-81c6-1f5ea5510c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e7c273d-cf30-49c4-a04b-1204eda0cdf7', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1c2eca-e6a1-482f-bcc2-cab9636b8516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:51 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Volume volume-7e7c273d-cf30-49c4-a04b-1204eda0cdf7 (7e7c273d-cf30-49c4-a04b-1204eda0cdf7): created successfully Jun 15 07:36:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1c2eca-e6a1-482f-bcc2-cab9636b8516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:51 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Flow 'volume_create_manager' (a2d5310c-d28a-4c88-b18e-1cac50092bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:51 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-3da264a8-8594-428a-899a-fa7d8b8c4dac tempest-CinderUnicodeTest-386674595 None] Created volume successfully. Jun 15 07:36:51 devstack sudo[111301]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.665s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:52 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] Deleted volume successfully. Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-e39272cb-3a17-4106-904a-66180bc616ff tempest-VolumeDependencyTests-340244090 None] Lock "cinder-cf87ba28-f404-47ec-9d5a-d3c44c133f1b-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Flow 'volume_create_manager' (7e7645ae-733b-437b-aa54-49a53d43252e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712a0511-9c22-4574-bec3-ce6393d63ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712a0511-9c22-4574-bec3-ce6393d63ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1445140870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14c9b49-e6cf-4279-a5c7-cc966273c432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3486475d0f430396667c7fd2410f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:52Z,use_quota=True,user_id='79317cbdb422489c875063f39002e3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b36184-6e1b-424b-b044-a25eefc83148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b36184-6e1b-424b-b044-a25eefc83148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b3cf01-0bf7-46d7-ae6a-8107ea72896b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b3cf01-0bf7-46d7-ae6a-8107ea72896b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e14c9b49-e6cf-4279-a5c7-cc966273c432', 'volume_name': 'volume-e14c9b49-e6cf-4279-a5c7-cc966273c432', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f976c9d-5b37-44e4-9d08-4109ba6229ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f976c9d-5b37-44e4-9d08-4109ba6229ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5af490a-ee11-4026-b981-85da2dc52386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:52 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Volume e14c9b49-e6cf-4279-a5c7-cc966273c432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e14c9b49-e6cf-4279-a5c7-cc966273c432', 'volume_size': 1} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1445140870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14c9b49-e6cf-4279-a5c7-cc966273c432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3486475d0f430396667c7fd2410f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:52Z,use_quota=True,user_id='79317cbdb422489c875063f39002e3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Creating volume e14c9b49-e6cf-4279-a5c7-cc966273c432 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:52 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:36:52 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:52 devstack sudo[111304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432 1073741824 Jun 15 07:36:52 devstack sudo[111304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:53 devstack sudo[111304]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432 1073741824" returned: 0 in 1.000s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:53 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:53 devstack sudo[111310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432 Jun 15 07:36:53 devstack sudo[111310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:54 devstack sudo[111310]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432" returned: 0 in 0.711s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5af490a-ee11-4026-b981-85da2dc52386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e14c9b49-e6cf-4279-a5c7-cc966273c432', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b891c612-b18c-44d9-94b4-fa25beef71a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:54 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Volume volume-e14c9b49-e6cf-4279-a5c7-cc966273c432 (e14c9b49-e6cf-4279-a5c7-cc966273c432): created successfully Jun 15 07:36:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b891c612-b18c-44d9-94b4-fa25beef71a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:54 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Flow 'volume_create_manager' (7e7645ae-733b-437b-aa54-49a53d43252e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:54 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-2de510fe-88b0-4689-bf4c-16bdf4fab7e1 tempest-CinderUnicodeTest-386674595 None] Created volume successfully. Jun 15 07:36:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:54 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] Creating offline snapshot 561af173-e066-414d-a114-2b81fdf0e04c of volume e14c9b49-e6cf-4279-a5c7-cc966273c432 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:36:54 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dde0a8-5a36-4a8e-ae11-704b11906555]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:54 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:54 devstack sudo[111313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432 Jun 15 07:36:54 devstack sudo[111313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:55 devstack sudo[111313]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432" returned: 0 in 1.009s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:55 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:55 devstack sudo[111318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c 1G Jun 15 07:36:55 devstack sudo[111318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:56 devstack sudo[111318]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c 1G" returned: 0 in 1.057s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:56 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e14c9b49-e6cf-4279-a5c7-cc966273c432 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:56 devstack sudo[111324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e14c9b49-e6cf-4279-a5c7-cc966273c432 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c Jun 15 07:36:56 devstack sudo[111324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:57 devstack sudo[111324]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e14c9b49-e6cf-4279-a5c7-cc966273c432 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c" returned: 0 in 0.816s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:57 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c is being set with open permissions: ugo+rw Jun 15 07:36:57 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:57 devstack sudo[111331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c Jun 15 07:36:57 devstack sudo[111331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:58 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:36:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Flow 'volume_create_manager' (b15e1075-e4f6-496d-86f8-077e02965e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e04fbe0-ba80-46ec-badf-b7086dba6c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e04fbe0-ba80-46ec-badf-b7086dba6c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1965802660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fad2480-68d6-4e93-ae6f-a1c4e530f5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cb69410617443686e2821cf251e4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:58Z,use_quota=True,user_id='17620f89435e429093cd312dcfeef422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7de067-cd48-40a4-a759-7cc8ea36ec68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:58 devstack sudo[111331]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7de067-cd48-40a4-a759-7cc8ea36ec68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb0d405-078d-4aca-a2c2-e08872c29812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb0d405-078d-4aca-a2c2-e08872c29812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fad2480-68d6-4e93-ae6f-a1c4e530f5c2', 'volume_name': 'volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf54b18-5f1c-4e5b-815e-2871fb8530dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf54b18-5f1c-4e5b-815e-2871fb8530dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:58 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c1af7a-855c-4188-8551-54671a519bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:58 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Volume 2fad2480-68d6-4e93-ae6f-a1c4e530f5c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2', 'volume_size': 1} Jun 15 07:36:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c" returned: 0 in 0.696s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:58 devstack sudo[111334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.info Jun 15 07:36:58 devstack sudo[111334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:58 devstack sudo[111334]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.info" returned: 0 in 0.602s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:58 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.info is being set with open permissions: ugo+rw Jun 15 07:36:58 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:58 devstack sudo[111337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.info Jun 15 07:36:58 devstack sudo[111337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Flow 'volume_create_manager' (8790a289-47f6-4c53-86d5-1f6589d45cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b4cbe0-603b-480e-9a05-f3a96ffaef87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b4cbe0-603b-480e-9a05-f3a96ffaef87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2cc7888-45d1-4e0a-baa2-05a8972fe17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0adac521ff7f4cc4a3cd7a8d5cbe6169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:59Z,use_quota=True,user_id='0a995b9872374a9180eb5e2d87d0f0f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ec46fe-2135-4e40-8247-507906f2872a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ec46fe-2135-4e40-8247-507906f2872a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440be6b9-334e-4845-ae71-b3e4f57ef14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.image.glance [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Creating Keystone auth plugin from conf {{(pid=92129) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440be6b9-334e-4845-ae71-b3e4f57ef14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2cc7888-45d1-4e0a-baa2-05a8972fe17d', 'volume_name': 'volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d', 'volume_size': 1, 'image_id': '78bd93c0-925f-44cb-a431-67e0c35cb58c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/78bd93c0-925f-44cb-a431-67e0c35cb58c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a854dab7eba98e5818249b2bcd3a9f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0adac521ff7f4cc4a3cd7a8d5cbe6169', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3deaf6eac34b9150cd00df8d5a156c6bdd35ef98e178a3f433060e55d40664c7d0490b3296d4c23006b3ef83f54e1aeac0d2a4ab55e969baf2c02359ca47b37', 'id': '78bd93c0-925f-44cb-a431-67e0c35cb58c', 'created_at': datetime.datetime(2026, 6, 15, 5, 36, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 36, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/78bd93c0-925f-44cb-a431-67e0c35cb58c/file', 'properties': {}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d7d785-4716-4779-8acc-dd3a55d6a493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d7d785-4716-4779-8acc-dd3a55d6a493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891b8a13-7b8e-4273-a8c1-1496d1b2c6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:59 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Volume d2cc7888-45d1-4e0a-baa2-05a8972fe17d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d', 'volume_size': 1, 'image_id': '78bd93c0-925f-44cb-a431-67e0c35cb58c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/78bd93c0-925f-44cb-a431-67e0c35cb58c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a854dab7eba98e5818249b2bcd3a9f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0adac521ff7f4cc4a3cd7a8d5cbe6169', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3deaf6eac34b9150cd00df8d5a156c6bdd35ef98e178a3f433060e55d40664c7d0490b3296d4c23006b3ef83f54e1aeac0d2a4ab55e969baf2c02359ca47b37', 'id': '78bd93c0-925f-44cb-a431-67e0c35cb58c', 'created_at': datetime.datetime(2026, 6, 15, 5, 36, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 36, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/78bd93c0-925f-44cb-a431-67e0c35cb58c/file', 'properties': {}}, 'image_service': } Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Trying to clone d2cc7888-45d1-4e0a-baa2-05a8972fe17d from image 78bd93c0-925f-44cb-a431-67e0c35cb58c at location (None, [{'url': 'file:///opt/stack/data/glance/images/78bd93c0-925f-44cb-a431-67e0c35cb58c', 'metadata': {}}]). {{(pid=92129) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:36:59 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Image download 0.00 MB at 0.00 MB/s Jun 15 07:36:59 devstack sudo[111337]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.info" returned: 0 in 0.696s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.972s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.355s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1965802660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fad2480-68d6-4e93-ae6f-a1c4e530f5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cb69410617443686e2821cf251e4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:58Z,use_quota=True,user_id='17620f89435e429093cd312dcfeef422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Creating volume 2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:59 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:59 devstack sudo[111340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 1073741824 Jun 15 07:36:59 devstack sudo[111340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ec5f5f-1700-4970-9f43-5de3d3779d74]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:59 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-4ab891c3-2f5b-4fa4-99be-b9d4a7cf9371 tempest-CinderUnicodeTest-386674595 None] Create snapshot completed successfully Jun 15 07:36:59 devstack sudo[111342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD Jun 15 07:36:59 devstack sudo[111342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:59 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] Acquiring lock "cinder-561af173-e066-414d-a114-2b81fdf0e04c-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] Lock "cinder-561af173-e066-414d-a114-2b81fdf0e04c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] Acquiring lock "cinder-quobyte-e14c9b49-e6cf-4279-a5c7-cc966273c432" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] Lock "cinder-quobyte-e14c9b49-e6cf-4279-a5c7-cc966273c432" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] Acquiring lock "cinder-quobyte-561af173-e066-414d-a114-2b81fdf0e04c" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:00 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] Lock "cinder-quobyte-561af173-e066-414d-a114-2b81fdf0e04c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] Deleting offline snapshot 561af173-e066-414d-a114-2b81fdf0e04c of volume e14c9b49-e6cf-4279-a5c7-cc966273c432 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:37:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] snapshot_file for this snap is: volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:37:00 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8be7660-3cdc-49b3-ba5b-a0bfbf54046a]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:00 devstack sudo[111345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c Jun 15 07:37:00 devstack sudo[111345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:00 devstack sudo[111342]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD" returned: 0 in 0.782s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:00 devstack sudo[111340]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 1073741824" returned: 0 in 0.874s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:00 devstack sudo[111354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 Jun 15 07:37:00 devstack sudo[111354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:00 devstack sudo[111353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD Jun 15 07:37:00 devstack sudo[111353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:00 devstack sudo[111345]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c" returned: 0 in 0.771s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:00 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e14c9b49-e6cf-4279-a5c7-cc966273c432(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:37:00 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1d3ffc-3949-4ed9-a442-2bce547166d0]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:00 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:01 devstack sudo[111360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432 Jun 15 07:37:01 devstack sudo[111360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:01 devstack sudo[111354]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2" returned: 0 in 0.628s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c1af7a-855c-4188-8551-54671a519bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2', 'volume_size': 1}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04edaf19-9df0-429c-afa6-32b9aa7d75aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:37:01 devstack sudo[111353]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD" returned: 1 in 0.762s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Temporary image 78bd93c0-925f-44cb-a431-67e0c35cb58c is fetched for user 0a995b9872374a9180eb5e2d87d0f0f1. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:37:01 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Volume volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 (2fad2480-68d6-4e93-ae6f-a1c4e530f5c2): created successfully Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04edaf19-9df0-429c-afa6-32b9aa7d75aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Flow 'volume_create_manager' (b15e1075-e4f6-496d-86f8-077e02965e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:37:01 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f4a3ea08-18a4-4cd0-89e8-5d0a41280e6e tempest-SnapshotDependencyTests-994585226 None] Created volume successfully. Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2b53dd-a17c-4bde-98be-508077312914]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:01 devstack sudo[111366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD Jun 15 07:37:01 devstack sudo[111366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:01 devstack sudo[111360]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432" returned: 0 in 0.840s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:01 devstack sudo[111371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c Jun 15 07:37:01 devstack sudo[111371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] Creating offline snapshot 5963f071-819a-446e-bc24-d0a5c50e68df of volume 2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 {{(pid=92129) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b728c138-9214-4dee-a8b9-3e63b07bdf05]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:01 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:01 devstack sudo[111373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 Jun 15 07:37:01 devstack sudo[111373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:02 devstack sudo[111366]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD" returned: 0 in 0.802s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:02 devstack sudo[111377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD Jun 15 07:37:02 devstack sudo[111377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:02 devstack sudo[111371]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c" returned: 0 in 0.826s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:02 devstack sudo[111386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c Jun 15 07:37:02 devstack sudo[111386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:02 devstack sudo[111373]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2" returned: 0 in 0.821s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:02 devstack sudo[111388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df 1G Jun 15 07:37:02 devstack sudo[111388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:02 devstack sudo[111377]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD" returned: 1 in 0.812s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:37:02 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:37:03 devstack sudo[111386]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432.561af173-e066-414d-a114-2b81fdf0e04c" returned: 0 in 0.606s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:03 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] Lock "cinder-quobyte-561af173-e066-414d-a114-2b81fdf0e04c" released by "_delete_snapshot" :: held 3.173s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:03 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] Lock "cinder-quobyte-e14c9b49-e6cf-4279-a5c7-cc966273c432" released by "delete_snapshot" :: held 3.198s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:03 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] Created reservations ['dd34aa4f-dd38-4a9a-b5cd-6b0f98e5b9a9', 'f24454e6-2a76-48a4-8182-38232899eec6', '30126775-5189-42d6-9593-94864e83b772', '52bf57d1-86a5-41f3-889c-64200ed14634'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:37:03 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] Delete snapshot completed successfully. Jun 15 07:37:03 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-138382a3-ad33-4962-aed0-8e39d98b9b1b tempest-CinderUnicodeTest-386674595 None] Lock "cinder-561af173-e066-414d-a114-2b81fdf0e04c-delete_snapshot" released by "delete_snapshot" :: held 3.354s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:03 devstack sudo[111388]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df 1G" returned: 0 in 0.924s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:03 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:03 devstack sudo[111398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df Jun 15 07:37:03 devstack sudo[111398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:04 devstack sudo[111398]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 -F qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df" returned: 0 in 0.628s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:04 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df is being set with open permissions: ugo+rw Jun 15 07:37:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:04 devstack sudo[111403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df Jun 15 07:37:04 devstack sudo[111403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] Acquiring lock "cinder-e14c9b49-e6cf-4279-a5c7-cc966273c432-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] Lock "cinder-e14c9b49-e6cf-4279-a5c7-cc966273c432-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] Acquiring lock "cinder-quobyte-e14c9b49-e6cf-4279-a5c7-cc966273c432" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:04 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] Lock "cinder-quobyte-e14c9b49-e6cf-4279-a5c7-cc966273c432" acquired by "delete_volume" :: waited 0.015s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:04 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2d08ac-b08e-4626-8d29-309b5f273f6c]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:04 devstack sudo[111405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432 Jun 15 07:37:04 devstack sudo[111405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:04 devstack sudo[111403]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df" returned: 0 in 0.661s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:04 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:UPDATE=230,cinder:SELECT=151,cinder:INSERT=60,cinder:DELETE=15 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:37:04 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:04 devstack sudo[111408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.info Jun 15 07:37:04 devstack sudo[111408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:05 devstack sudo[111405]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432" returned: 0 in 0.694s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:05 devstack sudo[111413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432 Jun 15 07:37:05 devstack sudo[111413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:05 devstack sudo[111408]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.info" returned: 0 in 0.655s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:05 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.info is being set with open permissions: ugo+rw Jun 15 07:37:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.info {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:05 devstack sudo[111417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.info Jun 15 07:37:05 devstack sudo[111417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:05 devstack sudo[111413]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-e14c9b49-e6cf-4279-a5c7-cc966273c432" returned: 0 in 0.596s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:05 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] Lock "cinder-quobyte-e14c9b49-e6cf-4279-a5c7-cc966273c432" released by "delete_volume" :: held 1.345s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:05 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] Created reservations ['ebea389c-07ff-4016-9c76-107570c1598b', '3ba4c6ce-075d-4f50-afad-2a53b09ad11e', 'b38aefda-48f3-46e7-b8e0-b32151aa6903', '4cbdd9db-fb00-426a-b152-65c5099bf14a'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:37:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:37:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:37:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:37:05 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:37:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:37:05 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:05 devstack sudo[111419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:37:05 devstack sudo[111419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:06 devstack sudo[111417]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.info" returned: 0 in 0.626s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.416s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.221s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2cc7888-45d1-4e0a-baa2-05a8972fe17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0adac521ff7f4cc4a3cd7a8d5cbe6169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:59Z,use_quota=True,user_id='0a995b9872374a9180eb5e2d87d0f0f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)}" {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Creating volume d2cc7888-45d1-4e0a-baa2-05a8972fe17d {{(pid=92129) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:37:06 devstack cinder-volume[92129]: INFO cinder.volume.drivers.remotefs [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] casted to osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d 1073741824 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:06 devstack sudo[111422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d 1073741824 Jun 15 07:37:06 devstack sudo[111422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:06 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f4ecef21-dab0-4241-b9fa-ec7d18a71923 tempest-SnapshotDependencyTests-994585226 None] Create snapshot completed successfully Jun 15 07:37:06 devstack sudo[111419]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.580s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:37:06 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] Deleted volume successfully. Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-363c5b9c-0332-48a6-af14-2bbe6a067a19 tempest-CinderUnicodeTest-386674595 None] Lock "cinder-e14c9b49-e6cf-4279-a5c7-cc966273c432-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] Acquiring lock "cinder-7e7c273d-cf30-49c4-a04b-1204eda0cdf7-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] Lock "cinder-7e7c273d-cf30-49c4-a04b-1204eda0cdf7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] Acquiring lock "cinder-quobyte-7e7c273d-cf30-49c4-a04b-1204eda0cdf7" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] Lock "cinder-quobyte-7e7c273d-cf30-49c4-a04b-1204eda0cdf7" acquired by "delete_volume" :: waited 0.023s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc62b1a-3549-43b3-8fe7-0e5219f3a79d]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:06 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7e7c273d-cf30-49c4-a04b-1204eda0cdf7 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:06 devstack sudo[111425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7e7c273d-cf30-49c4-a04b-1204eda0cdf7 Jun 15 07:37:06 devstack sudo[111425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:07 devstack sudo[111422]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d 1073741824" returned: 0 in 0.800s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:07 devstack sudo[111430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d Jun 15 07:37:07 devstack sudo[111430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:07 devstack sudo[111425]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7e7c273d-cf30-49c4-a04b-1204eda0cdf7" returned: 0 in 0.736s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7e7c273d-cf30-49c4-a04b-1204eda0cdf7 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:07 devstack sudo[111435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7e7c273d-cf30-49c4-a04b-1204eda0cdf7 Jun 15 07:37:07 devstack sudo[111435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92129) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Flow 'volume_create_manager' (0abfbadc-b1c5-4227-98ef-b2164a47dae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0859dd20-2508-4f6c-82e5-b6ad1eb3b8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0859dd20-2508-4f6c-82e5-b6ad1eb3b8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c3baa2-10a6-4c45-83bb-529d3e944089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cb69410617443686e2821cf251e4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5963f071-819a-446e-bc24-d0a5c50e68df,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:37:08Z,use_quota=True,user_id='17620f89435e429093cd312dcfeef422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17825b9d-12da-49bd-9e5e-d1b99032249e),volume_type_id=17825b9d-12da-49bd-9e5e-d1b99032249e)' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb6d1c6-afc8-4505-a722-53f824b29289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb6d1c6-afc8-4505-a722-53f824b29289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b43a1ee-ebff-49fe-b428-6e8a66aee0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:37:07 devstack sudo[111430]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b43a1ee-ebff-49fe-b428-6e8a66aee0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '54c3baa2-10a6-4c45-83bb-529d3e944089', 'volume_name': 'volume-54c3baa2-10a6-4c45-83bb-529d3e944089', 'volume_size': 1, 'snapshot_id': '5963f071-819a-446e-bc24-d0a5c50e68df'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84cf4118-4233-42fc-b66a-780d39db3b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84cf4118-4233-42fc-b66a-780d39db3b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36ec214-ce51-47da-9eaa-a46de29122e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:37:07 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Volume 54c3baa2-10a6-4c45-83bb-529d3e944089: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-54c3baa2-10a6-4c45-83bb-529d3e944089', 'volume_size': 1, 'snapshot_id': '5963f071-819a-446e-bc24-d0a5c50e68df'} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d" returned: 0 in 0.693s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'} {{(pid=92129) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Acquiring lock "cinder-quobyte-5963f071-819a-446e-bc24-d0a5c50e68df-54c3baa2-10a6-4c45-83bb-529d3e944089" by "_create_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-quobyte-5963f071-819a-446e-bc24-d0a5c50e68df-54c3baa2-10a6-4c45-83bb-529d3e944089" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Creating volume 54c3baa2-10a6-4c45-83bb-529d3e944089 from snapshot 5963f071-819a-446e-bc24-d0a5c50e68df {{(pid=92129) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Selected osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b as target Quobyte volume. {{(pid=92129) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Acquiring lock "cinder-quobyte-54c3baa2-10a6-4c45-83bb-529d3e944089" by "_copy_volume_from_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Attempting download of 78bd93c0-925f-44cb-a431-67e0c35cb58c ((None, [{'url': 'file:///opt/stack/data/glance/images/78bd93c0-925f-44cb-a431-67e0c35cb58c', 'metadata': {}}])) to volume d2cc7888-45d1-4e0a-baa2-05a8972fe17d. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-quobyte-54c3baa2-10a6-4c45-83bb-529d3e944089" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] snapshot: 5963f071-819a-446e-bc24-d0a5c50e68df, volume: 54c3baa2-10a6-4c45-83bb-529d3e944089, {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6af95f6-3ca8-4c5c-b05e-141b90d083b6]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_78bd93c0-925f-44cb-a431-67e0c35cb58c_y4_df4n6 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a8cb67-e7e8-451b-929d-e6c3d180ba56]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:07 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:07 devstack sudo[111441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_78bd93c0-925f-44cb-a431-67e0c35cb58c_y4_df4n6 Jun 15 07:37:07 devstack sudo[111441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:07 devstack sudo[111442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df Jun 15 07:37:07 devstack sudo[111442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:08 devstack sudo[111435]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-7e7c273d-cf30-49c4-a04b-1204eda0cdf7" returned: 0 in 0.740s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] Lock "cinder-quobyte-7e7c273d-cf30-49c4-a04b-1204eda0cdf7" released by "delete_volume" :: held 1.522s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] Created reservations ['1434976e-870b-458f-b055-56858ba64f7f', '0b346a63-5a98-4b5f-b774-5f0de1d1187d', 'c7277b12-fbc2-468f-bf75-7c679d49408a', '8dc2b5e3-60b6-485a-a13a-dea8c8f56939'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:08 devstack sudo[111446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:37:08 devstack sudo[111446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:08 devstack sudo[111441]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_78bd93c0-925f-44cb-a431-67e0c35cb58c_y4_df4n6" returned: 0 in 0.726s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_78bd93c0-925f-44cb-a431-67e0c35cb58c_y4_df4n6 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:08 devstack sudo[111442]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df" returned: 0 in 0.768s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Creating direct copy from snapshot {{(pid=92129) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c47af8-4471-49cc-9765-9099090b5481]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:08 devstack sudo[111454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_78bd93c0-925f-44cb-a431-67e0c35cb58c_y4_df4n6 Jun 15 07:37:08 devstack sudo[111454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:08 devstack sudo[111455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 Jun 15 07:37:08 devstack sudo[111455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:08 devstack sudo[111446]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.675s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:37:08 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] Deleted volume successfully. Jun 15 07:37:08 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-a96f33dd-82cf-4b50-a243-902269a08a71 tempest-CinderUnicodeTest-386674595 None] Lock "cinder-7e7c273d-cf30-49c4-a04b-1204eda0cdf7-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:09 devstack sudo[111454]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_78bd93c0-925f-44cb-a431-67e0c35cb58c_y4_df4n6" returned: 1 in 0.799s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_78bd93c0-925f-44cb-a431-67e0c35cb58c_y4_df4n6' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:37:09 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efe206c-1796-483f-a0da-cf471ee29c13]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:09 devstack sudo[111455]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2" returned: 0 in 0.759s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:09 devstack cinder-volume[92129]: DEBUG cinder.utils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Path /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54c3baa2-10a6-4c45-83bb-529d3e944089 not found in is_blk_device check {{(pid=92129) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:37:09 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54c3baa2-10a6-4c45-83bb-529d3e944089 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:09 devstack sudo[111465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54c3baa2-10a6-4c45-83bb-529d3e944089 Jun 15 07:37:09 devstack sudo[111465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:09 devstack sudo[111464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD Jun 15 07:37:09 devstack sudo[111464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:10 devstack sudo[111464]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD" returned: 0 in 0.776s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:10 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:10 devstack sudo[111474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD Jun 15 07:37:10 devstack sudo[111474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:11 devstack sudo[111474]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD" returned: 1 in 1.285s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:37:11 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] 78bd93c0-925f-44cb-a431-67e0c35cb58c was raw, converting to raw {{(pid=92129) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:37:11 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:11 devstack sudo[111486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d Jun 15 07:37:11 devstack sudo[111486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:12 devstack sudo[111486]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d" returned: 0 in 1.496s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:12 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_78bd93c0-925f-44cb-a431-67e0c35cb58c_8z4uoufidevstack@QuobyteHD, size 0.00 MB, duration 1.50 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:37:12 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Converted 0.00 MB image at 0.00 MB/s Jun 15 07:37:12 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d 1G {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:13 devstack sudo[111491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d 1G Jun 15 07:37:13 devstack sudo[111491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:13 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:37:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:37:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:37:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:37:13 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:37:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:37:13 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:14 devstack sudo[111496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:37:14 devstack sudo[111496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:14 devstack sudo[111491]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d 1G" returned: 0 in 1.272s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:14 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7d8ae8-2178-450e-be2b-89d4dc713792]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:14 devstack sudo[111499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d Jun 15 07:37:14 devstack sudo[111499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:14 devstack sudo[111465]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54c3baa2-10a6-4c45-83bb-529d3e944089" returned: 0 in 5.323s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:14 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[558c1614-6810-458c-9784-dc2c1c354ec7]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:14 devstack sudo[111501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 Jun 15 07:37:14 devstack sudo[111501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:14 devstack sudo[111496]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:14 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.998s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:14 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:37:14 devstack cinder-volume[92129]: DEBUG oslo_service.periodic_task [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] Running periodic task VolumeManager._thread_info {{(pid=92129) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:37:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread count: 28 {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:37:14 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-f422c6e0-ad8a-41cc-b050-b7c8baa99efd None None] thread info: [<_MainThread(MainThread, started 136067713970304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92129) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:37:15 devstack sudo[111499]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d" returned: 0 in 0.902s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:15 devstack sudo[111506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d Jun 15 07:37:15 devstack sudo[111506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:15 devstack sudo[111501]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2" returned: 0 in 0.929s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:15 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Image conversion details: src /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54c3baa2-10a6-4c45-83bb-529d3e944089 {{(pid=92129) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:37:15 devstack cinder-volume[92129]: INFO cinder.image.image_utils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Converted 1024.00 MB image at 192.31 MB/s Jun 15 07:37:15 devstack cinder-volume[92129]: WARNING cinder.volume.drivers.remotefs [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54c3baa2-10a6-4c45-83bb-529d3e944089 is being set with open permissions: ugo+rw Jun 15 07:37:15 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54c3baa2-10a6-4c45-83bb-529d3e944089 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:15 devstack sudo[111511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54c3baa2-10a6-4c45-83bb-529d3e944089 Jun 15 07:37:15 devstack sudo[111511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:15 devstack sudo[111506]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d" returned: 1 in 0.724s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Downloaded image 78bd93c0-925f-44cb-a431-67e0c35cb58c ((None, [{'url': 'file:///opt/stack/data/glance/images/78bd93c0-925f-44cb-a431-67e0c35cb58c', 'metadata': {}}])) to volume d2cc7888-45d1-4e0a-baa2-05a8972fe17d successfully. {{(pid=92129) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.image.image_utils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Temporary image 78bd93c0-925f-44cb-a431-67e0c35cb58c for user 0a995b9872374a9180eb5e2d87d0f0f1 is deleted. {{(pid=92129) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.volume.volume_utils [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Marking volume d2cc7888-45d1-4e0a-baa2-05a8972fe17d as bootable. {{(pid=92129) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Copying metadata from image 78bd93c0-925f-44cb-a431-67e0c35cb58c to d2cc7888-45d1-4e0a-baa2-05a8972fe17d. {{(pid=92129) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.volume.flows.manager.create_volume [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Creating volume glance metadata for volume d2cc7888-45d1-4e0a-baa2-05a8972fe17d backed by image 78bd93c0-925f-44cb-a431-67e0c35cb58c with: {'image_id': '78bd93c0-925f-44cb-a431-67e0c35cb58c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1a854dab7eba98e5818249b2bcd3a9f7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92129) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891b8a13-7b8e-4273-a8c1-1496d1b2c6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d', 'volume_size': 1, 'image_id': '78bd93c0-925f-44cb-a431-67e0c35cb58c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/78bd93c0-925f-44cb-a431-67e0c35cb58c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a854dab7eba98e5818249b2bcd3a9f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0adac521ff7f4cc4a3cd7a8d5cbe6169', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3deaf6eac34b9150cd00df8d5a156c6bdd35ef98e178a3f433060e55d40664c7d0490b3296d4c23006b3ef83f54e1aeac0d2a4ab55e969baf2c02359ca47b37', 'id': '78bd93c0-925f-44cb-a431-67e0c35cb58c', 'created_at': datetime.datetime(2026, 6, 15, 5, 36, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 36, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/78bd93c0-925f-44cb-a431-67e0c35cb58c/file', 'properties': {}}, 'image_service': }' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338bb7d1-3993-4224-a834-ace23b9ae9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:37:16 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Volume volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d (d2cc7888-45d1-4e0a-baa2-05a8972fe17d): created successfully Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338bb7d1-3993-4224-a834-ace23b9ae9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Flow 'volume_create_manager' (8790a289-47f6-4c53-86d5-1f6589d45cc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:37:16 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-7627ada9-db47-4bde-8bec-802168e413f9 tempest-VolumeImageDependencyTests-1083384897 None] Created volume successfully. Jun 15 07:37:16 devstack sudo[111511]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54c3baa2-10a6-4c45-83bb-529d3e944089" returned: 0 in 0.631s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-quobyte-54c3baa2-10a6-4c45-83bb-529d3e944089" released by "_copy_volume_from_snapshot" :: held 8.525s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-quobyte-5963f071-819a-446e-bc24-d0a5c50e68df-54c3baa2-10a6-4c45-83bb-529d3e944089" released by "_create_volume_from_snapshot" :: held 8.559s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.577s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36ec214-ce51-47da-9eaa-a46de29122e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54c3baa2-10a6-4c45-83bb-529d3e944089', 'volume_size': 1, 'snapshot_id': '5963f071-819a-446e-bc24-d0a5c50e68df'}' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ea14c1-f0ec-408d-aab0-bf9110f6ea8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:37:16 devstack cinder-volume[92129]: INFO cinder.volume.flows.manager.create_volume [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Volume volume-54c3baa2-10a6-4c45-83bb-529d3e944089 (54c3baa2-10a6-4c45-83bb-529d3e944089): created successfully Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ea14c1-f0ec-408d-aab0-bf9110f6ea8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92129) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.volume.manager [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Flow 'volume_create_manager' (0abfbadc-b1c5-4227-98ef-b2164a47dae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92129) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:37:16 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-fb397c7e-f57e-4218-9760-cec2c8738d75 tempest-SnapshotDependencyTests-994585226 None] Created volume successfully. Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] Acquiring lock "cinder-5963f071-819a-446e-bc24-d0a5c50e68df-delete_snapshot" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-5963f071-819a-446e-bc24-d0a5c50e68df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] Acquiring lock "cinder-quobyte-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2" by "delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-quobyte-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] Acquiring lock "cinder-quobyte-5963f071-819a-446e-bc24-d0a5c50e68df" by "_delete_snapshot" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-quobyte-5963f071-819a-446e-bc24-d0a5c50e68df" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] Deleting offline snapshot 5963f071-819a-446e-bc24-d0a5c50e68df of volume 2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] snapshot_file for this snap is: volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df {{(pid=92129) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c33f32-fa8d-4705-b933-9181183cb5f1]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Acquiring lock "cinder-d2cc7888-45d1-4e0a-baa2-05a8972fe17d-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Lock "cinder-d2cc7888-45d1-4e0a-baa2-05a8972fe17d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Acquiring lock "cinder-quobyte-d2cc7888-45d1-4e0a-baa2-05a8972fe17d" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Lock "cinder-quobyte-d2cc7888-45d1-4e0a-baa2-05a8972fe17d" acquired by "delete_volume" :: waited 0.014s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:16 devstack sudo[111517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df Jun 15 07:37:16 devstack sudo[111517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3801630e-bf9b-40ef-9426-83198bce15cf]: (4, 'raw') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:16 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:16 devstack sudo[111519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d Jun 15 07:37:16 devstack sudo[111519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:17 devstack sudo[111517]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df" returned: 0 in 0.703s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:17 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.remotefs [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92129) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:37:17 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[218e05a5-570f-459f-a7b1-2fc42fbd2f06]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:17 devstack sudo[111524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 Jun 15 07:37:17 devstack sudo[111524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:17 devstack sudo[111519]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d" returned: 0 in 0.720s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:17 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:17 devstack sudo[111528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d Jun 15 07:37:17 devstack sudo[111528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:18 devstack sudo[111524]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2" returned: 0 in 0.760s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:18 devstack sudo[111535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df Jun 15 07:37:18 devstack sudo[111535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:18 devstack sudo[111528]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d" returned: 1 in 0.721s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d' failed. Not Retrying. {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:37:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:18 devstack sudo[111538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d Jun 15 07:37:18 devstack sudo[111538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:18 devstack sudo[111538]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-d2cc7888-45d1-4e0a-baa2-05a8972fe17d" returned: 0 in 0.589s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:18 devstack sudo[111535]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df" returned: 0 in 0.704s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:18 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:18 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Lock "cinder-quobyte-d2cc7888-45d1-4e0a-baa2-05a8972fe17d" released by "delete_volume" :: held 2.106s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:18 devstack sudo[111544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df Jun 15 07:37:18 devstack sudo[111544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:18 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Created reservations ['41790c47-14a5-476f-8940-d896ca87a502', '237bba5f-cb6e-429c-acb5-44dce4fc96bd', 'f52d593f-55bf-448e-b8f9-f01d4f73e81a', '5e464df3-71d3-4120-a0a3-c76b52b8e076'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:19 devstack sudo[111546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:37:19 devstack sudo[111546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:19 devstack sudo[111544]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2.5963f071-819a-446e-bc24-d0a5c50e68df" returned: 0 in 0.643s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-quobyte-5963f071-819a-446e-bc24-d0a5c50e68df" released by "_delete_snapshot" :: held 2.920s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-quobyte-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2" released by "delete_snapshot" :: held 2.945s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:19 devstack sudo[111546]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.604s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:37:19 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Deleted volume successfully. Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-6d112ce4-205d-4e53-9b77-89027f1df3a5 tempest-VolumeImageDependencyTests-1083384897 None] Lock "cinder-d2cc7888-45d1-4e0a-baa2-05a8972fe17d-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] Created reservations ['b3e447dc-ce84-4e7e-aa37-0f0fc1a2e41e', '73bd7f09-8150-463d-8d07-91ef58c96a6b', 'bb7e0365-1a5b-4fdd-abd1-0e90ba05e938', '1a106346-2bb5-41b8-8bce-39dc51051a89'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:37:19 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] Delete snapshot completed successfully. Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-bfe35e64-fe4e-4f33-b0ee-3725052fa2f1 tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-5963f071-819a-446e-bc24-d0a5c50e68df-delete_snapshot" released by "delete_snapshot" :: held 3.096s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] Acquiring lock "cinder-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] Acquiring lock "cinder-quobyte-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-quobyte-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2" acquired by "delete_volume" :: waited 0.017s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c11c07e-bbb4-45c0-8944-1e5e8596a6d8]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:19 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:20 devstack sudo[111550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 Jun 15 07:37:20 devstack sudo[111550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:20 devstack sudo[111550]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2" returned: 0 in 0.756s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:20 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:20 devstack sudo[111556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2 Jun 15 07:37:20 devstack sudo[111556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:21 devstack sudo[111556]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2" returned: 0 in 0.643s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:21 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-quobyte-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2" released by "delete_volume" :: held 1.455s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:21 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] Created reservations ['2eca4ce5-f90c-454f-8f31-4711af99880b', 'afb88e3d-c551-4008-82ae-264c3dc0a20c', '4554c203-b0be-466c-a159-9bf6c4739696', '0fbba726-d30c-41a7-8f77-03e8cd84800e'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:37:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:37:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:37:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:37:21 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:37:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:37:21 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:21 devstack sudo[111559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:37:21 devstack sudo[111559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] Acquiring lock "cinder-54c3baa2-10a6-4c45-83bb-529d3e944089-delete_volume" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-54c3baa2-10a6-4c45-83bb-529d3e944089-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:22 devstack sudo[111559]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.623s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:22 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:37:22 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] Deleted volume successfully. Jun 15 07:37:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] Acquiring lock "cinder-quobyte-54c3baa2-10a6-4c45-83bb-529d3e944089" by "delete_volume" {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:37:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-f4724069-3da3-41a1-a202-9d752c20a14e tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-2fad2480-68d6-4e93-ae6f-a1c4e530f5c2-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:22 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-quobyte-54c3baa2-10a6-4c45-83bb-529d3e944089" acquired by "delete_volume" :: waited 0.021s {{(pid=92129) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:37:22 devstack cinder-volume[92129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8340d834-6956-4536-b126-39d144e7e549]: (4, 'qcow2') {{(pid=93211) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54c3baa2-10a6-4c45-83bb-529d3e944089 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:22 devstack sudo[111562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54c3baa2-10a6-4c45-83bb-529d3e944089 Jun 15 07:37:22 devstack sudo[111562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:22 devstack sudo[111562]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54c3baa2-10a6-4c45-83bb-529d3e944089" returned: 0 in 0.687s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:22 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54c3baa2-10a6-4c45-83bb-529d3e944089 {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:22 devstack sudo[111567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54c3baa2-10a6-4c45-83bb-529d3e944089 Jun 15 07:37:22 devstack sudo[111567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:23 devstack sudo[111567]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b/volume-54c3baa2-10a6-4c45-83bb-529d3e944089" returned: 0 in 0.619s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:23 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-quobyte-54c3baa2-10a6-4c45-83bb-529d3e944089" released by "delete_volume" :: held 1.344s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:23 devstack cinder-volume[92129]: DEBUG cinder.quota [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] Created reservations ['2f3019dc-5df3-4a86-9e36-4e503137d8cd', 'a933dc47-ab83-4287-9156-1e95b0758450', '04bab415-2e76-4a79-9d78-bf09a7c223f9', '3b47db48-1a74-4009-b707-94e1a1a7b3b9'] {{(pid=92129) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:37:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:37:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:37:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b': None} {{(pid=92129) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:37:23 devstack cinder-volume[92129]: DEBUG cinder.volume.drivers.quobyte [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6111362-6d0c-45a8-a53b-4effc6261e7b'] {{(pid=92129) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:37:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.lockutils [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92129) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:37:23 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:23 devstack sudo[111570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b Jun 15 07:37:23 devstack sudo[111570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:24 devstack sudo[111570]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:24 devstack cinder-volume[92129]: DEBUG oslo_concurrency.processutils [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5111647c689aee38db42c612b46b1b0b" returned: 0 in 0.639s {{(pid=92129) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:24 devstack cinder-volume[92129]: DEBUG cinder.manager [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] Notifying Schedulers of capabilities ... {{(pid=92129) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:37:24 devstack cinder-volume[92129]: INFO cinder.volume.manager [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] Deleted volume successfully. Jun 15 07:37:24 devstack cinder-volume[92129]: DEBUG cinder.coordination [None req-c2e60690-3a1a-42d1-b139-23f5948785f9 tempest-SnapshotDependencyTests-994585226 None] Lock "cinder-54c3baa2-10a6-4c45-83bb-529d3e944089-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=92129) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:37:33 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=40,cinder:INSERT=17,cinder:UPDATE=47,cinder:DELETE=3 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:37:34 devstack cinder-volume[92129]: DEBUG dbcounter [-] [92129] Writing DB stats cinder:SELECT=63,cinder:INSERT=23,cinder:UPDATE=77,cinder:DELETE=7 {{(pid=92129) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}